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Ma j  or  Department :  Psychology 

This  study  analyzed  how  a  group's  decision  making  per¬ 
formance  compared  to  the  predicted  performance  of  a  statis¬ 
tically  "optimal"  group  on  a  visual  signal  detection  task. 
The  task  was  to  decide,  either  individually  or  as  a  group, 
whether  a  stimulus  display  screen  (composed  of  nine  inde¬ 
pendent  information  sources)  was  representative  of  one  of 
two  possible  normal  distributions  (signal  or  noise).  Eight 
subjects  were  tested  individually  and  as  members  of  differ¬ 
ent  sized  groups.  Sorkin  and  Dai's  1994  model  of  the  Ideal 
Group  was  used  to  analyze  the  accuracy  of  group  performance 
(d'gj.p).  Consistent  with  the  model  of  the  Ideal  Group, 
d'gj-p  increased  with  the  number  of  group  members,  but  de¬ 
creased  with  inter-member  correlation  and  task  difficulty. 

The  group  decision  process  was  assiimed  to  be  based  on 
the  group  assigning  different  weights  (emphasis)  to  each 
group  members'  input.  Overall  efficiency,  a  relative  measure 
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of  actual  performance  compared  to  ideal  performance,  was 
relatively  high  for  two-member  groups  but  decreased  as  the 
group  grew  larger.  Group  weighting  strategies  appeared  to 
be  somewhat  variable  for  the  condition  in  which  all  sources 
of  information  presented  to  the  members  were  equally  valid. 
However,  when  the  sources  of  information  were  unequal,  the 
group  appropriately  assigned  more  weight  to  the  group  mem¬ 
bers  with  the  more  reliable  information.  Some  interesting 
social  interaction  phenomena  were  theorized  to  take  place 
during  the  group  decision  process.  Social  loafing,  coordi¬ 
nation  loss  and  outgoingness  were  examined  as  possible 
reasons  for  changes  in  group  performance.  Interestingly, 
the  subjects  received  more  weight  when  they  acted  as  the 
spokesperson  for  the  group  compared  to  when  they  did  not 
respond  for  the  group. 
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INTRODUCTION 


Groups  of  all  kinds  frequently  make  important  decisions 
based  on  visual  sources  of  information.  Often  these  deci¬ 
sions  need  to  be  made  quickly  and  correctly.  For  instance, 
an  airplane  crew  needs  to  decide  if  they  are  experiencing  an 
actual  engine  problem  or  if  the  engine  gauges  are  malfunc¬ 
tioning.  Because  group  decisions  can  have  important  conse¬ 
quences,  we  are  interested  in  determining  how  well  groups 
perform  compared  to  a  statistically  optimum  group. 

Researchers  from  diverse  fields  have  studied  separate 
variables  and  theories  that  affect  group  performance  during 
the  decision  process.  Grofman,  Owen,  and  Feld  (1983) 
studied  the  effect  that  number  of  group  members  had  on 
group  performance.  Sniezeck  (1990)  analyzed  how  correla¬ 
tion  between  member's  estimates  of  weather  forecasts  affect¬ 
ed  the  group  performance.  Johnson  and  Torcivia  (1967) 
investigated  the  impact  of  individual  performance  on  group 
performance.  The  relative  weights  (emphasis)  assigned  to 
individual  group  members  during  the  group  interaction  have 
also  been  studied  (Sniezeck  &  Henry,  1988). 

The  aim  of  the  current  study  is  to  determine  how  well 
an  actual  group  performs  a  visual  detection  task  compared  to 
a  model  of  the  statistically  optimal  group,  the  Ideal  Group 
(Sorkin  &  Dai,  1994).  The  equations  describing  ideal  group 
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performance  integrate  several  of  the  previously  studied 
variables.  This  study  will  focus  on  determining  how  effi¬ 
ciently  the  actual  groups  weight  the  input  of  the  members 
and  how  their  performance  differs  from  ideal.  It  is  hoped 
that  the  comparison  between  the  actual  and  ideal  performance 
will  lead  to  better  predictions  about  group  performance. 
This  knowledge  may  then  lead  to  more  appropriate  training  in 
decision  making  groups. 

Most  of  the  prior  research  has  not  been  concerned  with 
the  statistical  analysis  of  group  performance  and  their 
results  have  been  described  in  general  terms.  For  instance, 
the  conclusion  has  been  made  that  the  group  with  three 
observers  performed  better  than  the  group  with  two  (Libby  & 
Blushfield,  1978  from  Grofman,  Feld  &  Owen,  1984).  But  the 
exact  increases  and  reasons  for  change  in  performance  were 
not  stated.  Reliable  predictions  concerning  group  perfor¬ 
mance  are  difficult  to  make  without  mathematical  analyses 
describing  ideal  performance. 

Sorkin  and  Dai  (1994)  applied  the  Theory  of  Signal 
Detection  (TSD,  Green  &  Swets,  1966;  Green,  1994)  to  derive 
the  mathematical  equations  that  describe  the  performance  of 
an  ideal  group.  Sorkin  and  Dai  describe  the  performance  of 
an  ideal  group  in  terms  of  the  number  of  observers  in  the 
group  (m),  the  correlation  between  the  individual  observers 
(r),  the  array  of  the  individual  observers  performance  prior 
to  group  interaction  (d'j^),  and  the  relative  weights  given 
to  each  observer's  estimate  (aj^).  The  current  study  will 
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examine  how  each  of  these  variables  actually  affects  group 
performance.  Sorkin  and  Dai  (1994)  assume  a  linear  group 
decision  process  based  on  free  group  interaction  and  the 
optimal  weighting  of  group  members'  individual  estimates  in 
order  to  make  a  group  decision.  Although  this  is  not  the 
only  possible  group  decision  process  (i.e.,  Delphi  group, 
closed  ballots,  majority  wins,  plurality  wins),  it  is  the 
method  that  statistically  provides  the  highest  achievable 
group  performance. 

Group  decision  making  processes  have  been  studied  for 
more  than  two  centuries  and  are  still  not  completely  under¬ 
stood.  The  Condorcet  Jury  Theorem  (Marguis  de  Condorcet, 
1785)  states  that  as  long  as  each  group  member  is  correct  at 
least  50  percent  of  the  time  (chance),  group  performance 
increases  monotonically  with  the  addition  of  group  members. 
Therefore,  by  adding  new  group  members,  the  group  perfor¬ 
mance  can  rapidly  approach  an  asymptote  of  perfect  perfor¬ 
mance.  However,  the  addition  of  members  that  perform  worse 
than  chance  would  result  in  the  group  performance  actually 
decreasing  (Grofman,  Owen  &  Feld,  1983). 

Grofman,  Feld,  and  Owen  (1984)  also  showed  that  the 
increase  in  group  performance  was  affected  by  the  difficulty 
of  the  task.  If  performance  was  less  than  50  percent  accu¬ 
rate,  then  the  group  performance  would  actually  decrease 
with  the  addition  of  group  members.  Another  theory  that 
predicts  group  performance  will  be  better  than  individual 
performance,  although  for  a  different  reason,  is  called 


truth-wins . 
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Truth-Wins .  The  Best  Member  or  Truth-Wins  Model  (Lorge 
&  Solomon,  1955)  contends  that  a  group  will  perform  better 
than  an  individual,  because  it  is  more  likely  that  one  of 
the  members  will  recognize  the  correct  decision  and  persuade 
the  group  to  respond  correctly.  Although  there  are  differ¬ 
ent  names  for  this  type  of  theory,  e.g.  Model  A  (Lorge  & 
Solomon,  1955),  Rational  Model  (Thomas  &  Fink,  1961),  stud¬ 
ies  testing  this  theory  (Lorge  &  Solomon,  1955;  Thomas  & 
Fink,  1961),  have  been  inconclusive  (Johnson  &  Torcivia, 
1967).  Hartwick  et  al.  (1982)  evaluated  several  studies  and 
determined  that  this  theory  over-predicts  group  performance 
and  is  probably  not  how  actual  groups  make  decisions. 

Error  checking.  Another  possibility  that  has  been 
suggested  as  to  why  groups  typically  outperform  individuals 
is  that  groups  are  better  able  to  check  for  and  reduce 
errors  that  individuals  might  make.  Vollrath  et  al .  (1989), 
in  a  mock  trial  scenario,  found  that  groups  tend  to  perform 
a  memory  task  better  than  individuals.  Their  study  suggest¬ 
ed  that  groups  may  reduce  individual  errors  of  commission 
and  omission  but  exaggerate  errors  of  implication.  However, 
Clark  and  Wade  (1986)  found  that  groups  were  more  likely  to 
correct  implicational  errors  than  individuals.  These  con¬ 
flicting  results  are  typical  of  the  theories  that  suggest 
groups  are  able  to  check  for  and  reduce  the  individual 
errors.  It  should  be  noted  that  the  current  study  will  not 
specifically  address  this  issue  since  there  is  no  way  of 
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determining  if  cin  improvement  in  group  performance  was  due 
to  a  reduction  of  errors. 

Pooling  of  information.  A  more  promising  theory  that 
attempts  to  explain  why  groups  typically  perform  better  than 
individuals  is  that  they  are  able  to  pool  their  information¬ 
al  resources.  This  type  of  theory  has  generally  been  sup¬ 
ported  by  experimental  research.  Vollrath  et  al .  (1989), 
studied  group  decision  making  in  a  mock  trial  scenario,  and 
found  that  the  greater  the  variability  between  members' 
estimates  the  more  the  group  improved  over  homogeneous 
groups.  Variability  across  subjects  leads  to  more  total 
information  available.  Hinsz  (1990)  found  that  group  per¬ 
formance  (d'gj-p),  while  evaluating  a  job  interview,  was  much 
better  than  individual  performance  (d'j^).  Both  of  these 
findings  support  the  theory  that  groups  benefit  from  the 
pooling  of  independent  information. 

The  greatest  improvement  in  performance  is  obtained  by 
the  optimum  combination  of  independent  informational  sourc¬ 
es.  The  Theory  of  Signal  Detection  provides  a  measure  of  how 
well  one  may  discriminate  whether  a  sample  was  drawn  from 
one  of  two  normal  distributions.  The  d'  statistic  repre¬ 
sents  this  value 


a 

Where  Pg  is  the  mean  of  the  signal  distribution,  Pn  “ 
and  a  is  the  standard  deviation  for  both  distributions. 
Suppose  the  samples  are  drawn  n  independent  times  and  are 
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added  together,  the  mean  of  the  summed  distribution  is  n  * 
Vig  and  the  variance  is  n  *  o^ ,  Then 

n  *  Us 

d'n  =  -  =  Jn  d'i  (2) 

a/tT  *  a 

This  is  the  maximum  gain  in  performance  available  due  to 
independent,  normal  informational  sources.  Partially  corre¬ 
lated  informational  sources  decrease  both  the  variability 
(total  information)  eind  the  potential  increase  in  group  per¬ 
formance.  The  pooling  of  information  theory  states  that  the 
more  abilities  and  memories  that  are  brought  together  on  a 
task,  the  better  the  group  performance. 

Correlation  between  sources  and  observers .  Another 
question  related  to  adding  group  members,  is  how  correlation 
between  information  sources  (Sniezeck,  1990),  as  well  as  the 
correlation  between  the  group  members  (Sniezeck  &  Henry, 
1989),  affects  group  performance. 

An  aviation  example  may  be  helpful  to  explain  how 
information  sources  can  be  correlated.  If  two  airplane 
engine  gauges  display  the  exact  same  information,  by  defini¬ 
tion,  they  are  perfectly  correlated.  The  addition  of  the 
second  gauge  results  in  a  zero  gain  in  available  information 
and  therefore  a  crew  cannot  improve  their  performance.  The 
other  extreme,  when  group  members  receive  independent  infor¬ 
mation  sources,  provides  the  maximum  amount  of  information 
available  to  the  group. 

Sniezeck  (1990)  found  the  performance  of  a  group  of 
experienced  weather  forecasters,  presented  with  highly 
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correlated  information,  to  be  no  better  than  individual 
performance.  In  a  related  finding,  Johnson  and  Torcivia 
(1967)  reported  that  a  high  correlation  of  knowledge  related 
to  performance  within  a  group  resulted  in  reduced  group 
performance.  They  theorized  this  occurred  because  each 
individual  contributed  mainly  common  and  little  unique 
information.  Even  though  the  correlation  between  informa¬ 
tion  sources  has  been  demonstrated  to  be  an  important 
determinant  in  group  performance,  it  is  often  not  addressed 
in  group  research  (for  example,  see  Hinsz,  1990).  If  mem¬ 
bers  of  a  group  are  from  similar  social  and  economic  back¬ 
grounds  it  is  likely  that  their  performance  and  responses 
will  be  correlated  and  thereby  reduce  the  variance  in  esti¬ 
mates  across  the  group.  This  reduction  in  variance  reduces 
the  possible  group  performance.  Therefore,  group  members 
from  different  backgrounds  may  increase  the  group  perfor¬ 
mance  more  than  group  members  with  similar  backgrounds. 

Hogarth  (1978),  in  a  study  of  group  performance,  made 
an  interesting  suggestion.  He  indicated  that,  in  order  to 
raise  group  performance,  it  may  be  beneficial  to  add  an 
observer  who  lowers  the  correlation  between  the  group 
members  even  if  that  new  member  is  not  the  best  observer. 
The  correlation  between  group  members  will  be  measured  in 
the  current  study  and  its  specific  effect  will  be  discussed. 

Relative  Weights 

During  the  group  decision  process,  we  assume  that  the 
group  makes  a  decision  by  differentially  weighting  the  input 
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of  each  of  the  individual  members.  Measuring  the  ways  that 
groups  distribute  relative  weights  (emphasis)  to  individual 
members  during  the  group  decision  process  is  an  important 
topic  in  group  research.  Optimal  group  performance  is 
accomplished  by  assigning  relative  weights  to  the  group 
members  based  on  their  individual  performance  (Grofman,  Owen 
&  Feld,  1983;  Green  &  Swets,  1966;  Green,  1994).  This 
statistical  calculation  states  that  relative  weights  should 
be  assigned  to  the  group  members  monotonically  with  the 
individual's  performance.  By  measuring  deviations  from 
ideal  weights  we  can  measure  one  way  in  which  groups  differ 
from  the  ideal. 

Sniezeck  and  Henry's  (1989)  study  of  individual  versus 
group  judgments  about  frequency  of  death  for  different 
causes  provides  support  for  the  theory  that  groups  perform¬ 
ing  a  group  judgment  do  more  than  average  the  individual 
inputs  or  take  the  median  response.  They  found  that  a  model 
assuming  equal  weighting  across  group  members  provided  a 
poor  fit  of  their  data.  Their  findings  suggest  that  the 
groups  weighted  individual  members  input  based  on  some 
criteria,  possibly  individual  performance. 

Individual  subject's  weighting.  While  the  study  of 
weights  assigned  to  individual  members  during  a  group  deci¬ 
sion  has  been  limited,  studies  of  weighting  strategies  used 
by  an  individual  are  more  frequent.  These  studies  have 
measured  the  relative  weights  that  individuals  assign  to 
different  information  sources  during  experimental  trials  in 
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order  to  make  a  decision.  For  instance,  the  results  of 
Montgomery  and  Sorkin  ( in  press )  demonstrated  that  individu¬ 
als,  given  cues,  can  weight  visual  sources  based  on  their 
difficulty.  In  addition,  Berg  and  Green  (1991)  showed  that 
listeners  can  concentrate  on  the  most  important  spectral 
channel  in  a  hearing  detection  task.  Furthermore,  Sorkin  et 
al.  (1991)  concluded  that,  given  enough  time,  individuals 
can  appropriately  weight  multiple  visual  elements. 

Prior  group  research  has  made  several  important  find¬ 
ings,  and  significant  strides  in  understanding  the  group 
decision  process  continue  to  be  made  (Gonzales,  1994;  Sa- 
muelson  &  Allison,  1994).  Both  of  these  studies  looked  at 
the  influence  that  group  members'  actions  had  on  one  anoth¬ 
er.  Since  there  are  still  several  interesting  questions 
about  the  group  decision  weighting  process,  the  current 
study  will  measure  the  groups'  ability  to  weight  observers 
based  on  their  individual  performance  abilities  and  the 
difficulty  of  their  respective  observations. 

Ideal  groups  should  weight  the  estimates  of  the  group 
members  according  to  each  individuals'  performance  and  the 
variability  of  the  information  the  individuals  observe. 
Returning  to  the  aviation  example,  when  both  members  of  a 
crew  receive  information  that  is  similar  in  difficulty,  to 
discriminate  signal  from  noise,  the  instructor  pilot  (who 
has  shown  excellent  performance)  should  be  given  more  rela¬ 
tive  weight  than  the  new  student  pilot.  However,  if  the 
instructor  is  reporting  information  from  a  gauge  that  is 
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difficult  to  discriminate  (displays  with  large  variability), 
his  input  should  receive  less  weight  than  a  pilot  who  is 
reporting  an  observation  from  a  gauge  that  is  less  difficult 
to  discriminate. 

Comparison  of  Human  and  Ideal  Performance 

Prior  studies  of  performance  in  display  based  visual 
signal  detection  tasks  (Sorkin,  Mabry,  Weldon,  &  Elvers, 
1991;  Montgomery  &  Sorkin,  in  press;  Ashby  &  Maddux,  1992) 
demonstrated  that  individual  observers,  after  extensive 
training,  can  become  accurate  and  consistent  decision  mak¬ 
ers.  Montgomery  and  Sorkin  (in  press)  found  that  individual 
observers  performing  a  discrimination  task,  using  a  multi¬ 
element  visual  display,  were  able  to  effectively  differen¬ 
tiate  and  weight  independent  gauge  values  based  on  their 
variability.  The  subjects  correctly  assigned  more  relative 
weight  to  the  display  values  that  had  smaller  variance  than 
to  values  with  higher  variance.  Furthermore,  individual 
performance  (d'),  on  the  discrimination  task  depended  on 
display  variability  in  a  predictable  way.  This  research 
suggests  that  individuals  can  perform  visual  detection  tasks 
effectively;  however,  it  is  still  uncertain  as  to  how  effi¬ 
ciently  groups  can  perform  these  tasks. 

Sorkin  and  Dai  (1994)  used  the  Theory  of  Signal  Detec¬ 
tion  to  calculate  the  normative  equations  that  represent 
ideal  group  performance.  The  following  section  summarizes 
their  analysis  of  the  Ideal  Group.  All  assumptions  and 
equations  listed  are  from  their  analysis  unless  stated 
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otherwise.  The  current  study  will  use  their  analysis  to 
evaluate  how  group  performance  compares  to  an  ideal  group. 

The  assumed  group  decision  process  is  shown  in  Figure 
1.  The  members  in  a  group  are  all  presented  information, 
and  they  have  to  decide  if  the  stimuli  were  representative 
of  a  noise  or  signal  trial.  The  stimuli  presented  to  the 
group  members,  on  a  given  trial,  are  drawn  from  the  same 
probability  distributions,  but  are  not  necessarily  identical 
across  subjects.  During  the  trial,  each  observer  may  be 
subject  to  several  noise  sources.  These  noise  sources  are 
divided  into  two  categories:  those  that  are  unique  to  each 
observer  (in  Figure  1  n^^,  n2,  n^)  and  those  noise  sources 
that  are  common  to  two  or  more  observers  ( 2 , 3 »  ^1,3)* 
noise  sources  are  all  assumed  to  be  additive,  normally 
distributed  Gaussian  random  variables  with  zero  mean  and 
variances  of  ,  02^  r  03^,  0^1,2, 3^'  *^1,3^  • 

After  the  stimulus  presentation  each  observer  offers 
her/his  estimate,  to  the  group.  These  estimates  are 

also  assumed  to  be  normally  distributed  Gaussian  random 
variables  with  a  mean  of  zero  on  noise  trials  and  a  mean  of 
on  signal  trials.  These  estimates  from  the  individual 
observers  X2,  X3>  form  the  group  estimate  vector,  x. 

Sorkin  and  Dai  show  that  the  weighted  sum  of  the  group 
members'  estimates  (x^)  forms  an  optimal  (likelihood  ratio) 
decision  statistic,  Z  =  Za^^Xj^.  The  group  then  compares  this 
decision  statistic  to  a  pre-set  criterion,  Z^,  to  decide  if 
they  should  answer  signal  or  noise.  The  group  decision 
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problem  is  analogous  to  that  of  detecting  a  signal  that  has 
components  in  m  channels.  This  decision  problem  is  similar 
to  the  multi-channel  auditory  signal  detection  problem 
examined  by  several  other  researchers  (e.g.  Berg,  1989, 
1990;  Berg  &  Green,  1990;  Durlach  et  al.,  1986;  &  Green, 
1988  ,  1992). 

The  detection  index  of  each  group  member,  d'j^,  is  a 
measure  of  how  well  the  subject  can  detect  signal  from 
noise.  For  example,  on  Figure  1, 

d'l  =  -  -  (3) 

+  0^1  2,3  ^^1,2 

The  relative  weights  assigned  to  each  group  member  during 
the  group  decision  process  is  designated  as  a^^.  The  corre¬ 
lation  between  the  group  members'  estimate  is  called  the 
inter-member  correlation. 

A  simplifying  ass\imption  is  that  all  the  unique  var¬ 
iances  are  equal  in  magnitude  across  the  members 

a^i  =  for  all  i.  (4) 

The  correlation  between  two  members  is  the  ratio  of  the 
common  (shared)  variance  to  the  total  variance 

^  “  ‘^^com/  (‘^^ind  °^^com^  * 

Each  group  members'  total  variance  is  normalized  by  setting 
=  1.  Then,  from  the  definition  of  correla¬ 
tion;  =  r  and  =  1  -  r.  Using  equations  derived 

by  Durlach,  Braida  and  Ito  (1986),  Sorkin  and  Dai  (1994) 
showed  that  the  performance  of  the  ideal  group  is: 
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Figure  1 .  Assumed  group  decision  process 
1994).  Each  group  member  experiences 
source  plus  noise  that  is  shared  with 
group  members.  The  noise  sources  are 
pendent  random  normal  variables  with 
specified  variances.  The  variances 
which  stimulus  event  was  presented, 
variable,  Z,  is  the  weighted  sum  of 
estimates . 
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' Ideal  Group 


m  Var  (d')  m(d')2  i 

[ -  +  - ] . 

1  -  r  1  +  r  (m-l) 


(6) 


This  important  equation  specifies  ideal  group  performance, 
where  m  is  the  number  of  group  members,  d'  is  the  mean  of 
all  and  Var  (d')  is  the  variance  of  the  d'j^.  In  the 

case  where  the  group  members'  estimates  are  independent 
( r  =  0 ) ,  then 

a'ldeal  Group  =  [■"  Var(d')  +  m  (d’)^^  (7) 

m 

=  [  2  (d'i)2]i.  (8) 

i=l 


This  is  the  independent  channel  prediction  made  by  Green  and 
Swets  (1966)  and  is  equal  to  ^  d'j^  when  all  dj^  are  equal. 

The  Ideal  Group  analysis  uses  four  primary  variables  to 
specify  group  performance.  These  variables  are:  number  of 
group  members  (m),  inter-member  correlation  (r),  and  the 
mean  and  variance  of  the  group  members'  d's.  These  varia¬ 
bles  can  be  thought  of  in  the  aviation  example.  The  d'j^  of 
the  group  involves  how  well  the  crew  members  can  determine 
if  they  are  experiencing  problems.  The  difficulty  of  dis¬ 
criminating  signal  from  noise  and  the  attentiveness  and 
skill  of  the  pilots  is  involved  in  this  measure.  The  corre¬ 
lation  between  the  group  members'  estimates  is  given  by  r. 
The  variable  r  involves  the  training  and  backgrounds  of  the 
crew  members  and  whether  the  crew  members  are  monitoring 
common  or  independent  sources  of  information. 
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By  looking  at  the  equation  describing  ideal  perfor¬ 
mance,  we  can  see  the  effects  of  each  variable.  As  dj^,  m, 
and  Var  d'  increases  so  does  Group*  However,  when 

inter-member  correlation  (r)  increases,  d' ideal  Group 
creases . 

Sorkin  and  Dai  (1994)  show  the  ideal  weights  (a^)  to  be 


1  +  r  (m-1)  _ 

=  -  d'l  -  m  d' 

r 


(9) 


The  ideal  weight  for  each  group  member  is  directly  propor¬ 
tional  to  the  individual's  d'^. 

Often  it  is  informative  to  determine  the  relative 
efficiency  of  an  actual  group.  The  efficiency  of  a  group 
(from  Tanner  &  Birdsall,  1958)  is  defined  as  the  ratio  of 
the  squared  d'  of  the  group  to  the  squared  d'  of  the  Ideal 
Group . 


^  actual  group 

observed  “  j 

Ideal  Group 


(10) 


The  reason  for  using  this  definition,  is  that  in  many  psy¬ 
chophysical  experiments,  the  ideal  (d')^  is  proportional  to 
signal  energy.  Therefore,  an  efficiency  level  of  .60  means 
that  the  Ideal  Group  would  need  only  60%  of  the  stimulus 
energy  to  perform  at  the  same  level  as  the  actual  group. 
Ideal  performance  would  result  in  efficiency  =  1.0  and  any 
performance  less  than  ideal  would  result  in  "  <  1.00. 
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Observed  efficiency  can  be  separated  into  two  efficien¬ 
cy  measures  to  determine  why  the  group  suffered  losses  in 
group  performance.  First,  weighting  efficiency  is  defined 
as  squared  over  Group  squared.  The  measure 
d' weight  assumes  ideal  performance  but  uses  the  actual 
weights  used  by  the  group  (Berg, 1990). 


n 


weight 


weight^  ^ 
Ideal  Group 


(11) 


Weighting  efficiency  measures  the  loss  in  group  performance 
(d'gj^p)  due  to  less  than  ideal  weights.  By  manipulating  the 
equations  given  in  Sorkin  and  Dai's  paper,  for  the 
actual  group  is; 


‘^'weight  “ 


Za^  d'i 


(12) 


Or  in  the  uncorrelated  case,  the  same  analysis  shows  that 


Zaid'i 

^'weight  “  ,  ^  (13) 

vZa 

The  second  efficiency  measure  (Berg,  1990),  "noise'  accounts 
for  additional  loss  in  d'g^-p  due  to  reasons  besides  weights. 


n  .  - 

noise  ~ 


^  '  observed  group  ^  ^ 
'weight ^  ^ 


(14) 


The  relationship  between  the  efficiency  measures  (Berg, 
1990)  is 

n  ,  =  n  .  .  .  *  n  •  flB'J 

obs  weight  noise- 
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Summary 

The  effect  of  group  size  has  been  studied  by  several 
researchers  (Grofman,  Owen  &  Feld,  1983;  Sniezeck  &  Henry, 
1989;  Vollrath,  Sheppard,  Hinsz  &  Davis,  1989).  Group  per¬ 
formance  is  generally  found  to  be  superior  to  that  of  an 
individual  (Hartwick  et  al,  1982).  Specific  findings  are: 
performance  improves  with  the  addition  of  observers  (Johnson 
St  Torcivia,  1967);  it  is  better  than  simply  averaging  the 
individual  responses  (Sniezeck  &  Henry,  1989);  and  that  it 
exceeds  the  performance  of  the  best  member  (Sniezeck  & 
Henry,  1989).  However,  the  specific  increase  in  performance 
gained  by  adding  an  additional  member  has  not  been  accurate¬ 
ly  predicted  (Vollrath  et  al,  1989). 

Several  theories  have  been  used  to  speculate  as  to  why 
groups  typically  perform  superior  to  individuals.  The  Best 
Member  and  Error  Checking  theories  have  yielded  mainly 
unfavorable  results,  whereas  the  Pooling  of  Information 
theory  seems  to  provide  a  more  likely  explanation. 

Research  from  several  fields  ranging  from  jury  research 
(Marquis  de  Condorcet,  1785)  to  group  memory  research 
(Hinsz,  1990)  to  psychophysics  (Montgomery,  1993;  Berg  & 
Green,  1991,  Sorkin  et  al.,  1991)  suggests  that  a  more 
complete  method  of  analysis  for  group  decision  research  is 
necessary.  The  current  study  will  investigate  previously 
studied  variables  that  have  shown  to  affect  group  perfor¬ 
mance.  Also,  actual  group  performance  will  be  compared 
against  an  ideal  to  determine  how  efficiently  groups  per- 
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form.  It  is  hoped  that  these  comparisons  may  be  used  to 
benefit  actual  decision-making  groups.  By  demonstrating 
typical  losses  in  possible  group  performance,  decision¬ 
making  groups  can  then  be  trained  to  be  aware  of  and  to 


avoid  them. 


METHOD 


The  subjects  performed,  either  individually  or  as  a 
group,  a  visual  signal  detection  task.  The  subjects  were 
presented  a  multiple  element  visual  display  screen,  composed 
of  nine  analog  gauges  (shown  in  Figure  2),  for  a  short 
period  of  time  (320  ms)  and  asked  to  respond  signal  or 
noise.  The  subjects  had  to  discriminate  if  the  stimulus 
display  screen  was  representative  of  samples  drawn  from  a 
normal  distribution  with  mean  =  Pg  (signal)  or  with  mean  = 
(noise).  Both  of  the  distributions  had  a  standard  devia¬ 
tion  =  a.  The  means  of  the  two  distributions  are  shown  as 
double  tick-marks  in  Figure  2  (Pg>Pjj) .  In  the  current 
study,  Pg  =  5.0  and  Pj^  =  4.0. 

The  difficulty  of  the  trials  was  controlled  by  adjust¬ 
ing  the  standard  deviation  of  the  noise  and  signal  stimulus 
distributions,  o.  A  stimulus  display  screen  that  exhibit¬ 
ed  large  variability,  for  example  a  =  3.0  (each  gauge), 
would  make  discriminating  signal  from  noise  difficult. 
Using  a  stimulus  display  screen  with  small  variability, 
for  example  a  =  1.5,  would  make  it  easier  to  discriminate 
which  distribution  was  used  to  generate  the  stimulus  dis¬ 
play. 
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Figure  2.  An  example  of  the  nine  vertical  gauges  presented 
on  a  stimulus  display  screen.  This  screen  was  pre¬ 
sented  to  an  individual  during  an  individual  subject 
trial  or  as  part  of  a  group  during  a  group  trial . 
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Subi ects 

Eight  University  of  Florida  students,  seven  women  and 
one  man,  19  to  23  years  of  age  participated  in  this  study. 
The  subjects  were  paid  4.25  dollars  per  hour.  A  small 
incentive  bonus  was  paid  based  on  the  subjects'  performance 
(approximately  40  cents  per  hour).  All  of  the  subjects  had 
normal  or  corrected- to-normal  visual  acuity.  The  subjects 
were  tested  both  individually  and  in  groups  of  different 
sizes. 

Apparatus  and  Stimuli 

Insight  486-33dx  computers  were  used  to  generate  and 
present  the  stimulus  display  screens  via  a  14  inch  CTX 
color  monitor  (1024  X  768  SVGA  monitor,  72  Hz  refresh  rate 
at  640  X  480  resolution).  Observers  sat  approximately  27 
inches  away  from  the  monitor  in  a  semi-quiet,  fluorescent 
lighted  laboratory  room.  The  monitor  was  set  for  maximum 
contrast,  and  the  intensity  was  set  at  approximately  100 
cd/m2,  measured  from  a  7.5  inch  by  10.5  inch  uniform  white 
field.  During  each  trial,  nine  vertical  gauges  were  pre¬ 
sented  subtending  a  visual  angle  of  approximately  8°  by  16° 
(vertical  by  horizontal).  Responses  were  made  via  a  stan¬ 
dard  computer  keyboard. 

The  individual  gauges,  shown  in  Figure  2,  consisted  of 
two  white,  parallel,  vertical  lines  with  tick  marks  on  the 
left  line  dividing  the  gauge  equally  in  one  number  incre¬ 
ments  from  0.0  to  10.0.  Two  larger  blue  tick  marks  marked 
the  mean  of  the  noise  (Pn^  signal  (Pg)  distributions 
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(4.0  and  5.0  respectively).  During  a  given  trial,  all  of 
the  gauges  on  a  stimulus  display  screen  displayed  values 
representative  of  the  same  distribution.  The  stimuli  were 
randomly  selected  from  the  signal  distribution  on  half  of 
the  trials  and  from  the  noise  distribution  on  the  other  half 
of  the  trials.  These  values  were  then  presented  as  horizon¬ 
tal,  white  dashes  on  the  gauges,  where  0.0  represented  the 
bottom  line  of  the  gauge  and  10.0  represented  the  top  line 
of  the  gauge. 

The  duration  of  the  stimulus  presentation  was  syn¬ 
chronized  with  the  refresh  traces  of  the  monitor.  The 
onset  and  offset  of  the  stimulus  presentation  were  delayed 
until  it  was  time  for  another  screen  refresh  (approximately 
every  13  ms).  The  stimulus  duration  was  370  ms  for  two 
practice  sessions.  The  remainder  of  the  trials  had  a  stimu¬ 
lus  duration  of  320  ms. 

During  the  group  phase  of  the  experiment,  the  subjects 
sat  in  front  of  their  individual  monitors;  the  group  mem¬ 
bers'  stimulus  display  screens  were  driven  simultaneously 
via  a  Local  Area  Network  (LAN).  This  prevented  subjects 
from  viewing  screens  other  than  their  own.  A  486-33dx 
computer  acted  as  the  "mini-network"  server  and  controlled 
the  experiment  by  synchronizing  the  trials  and  recording  the 
group's  performance  and  conditions.  During  each  trial,  this 
computer  randomly  assigned  one  of  the  group  members  to 
respond  for  the  group. 
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All  of  the  group  interaction  trials,  except  the  eight 
member  group,  took  place  in  the  same  room  as  the  individual 
trials  in  an  L-shaped  configuration.  The  server  computer 
was  approximately  five  feet  from  the  closest  member's  moni¬ 
tor  along  one  leg  of  the  L.  Seating  arrangements  during 
interaction  for  the  group  of  four  were  randomized  across 
sessions  with  two  members  side  by  side  (separated  by  24 
inches),  sitting  perpendicular  to  the  other  two  members 
(also  separated  by  24  inches),  and  separated  at  the  corner 
by  approximately  30  inches.  In  the  groups  of  two,  the 
members  sat  facing  the  Scime  direction  with  their  monitors 
separated  by  24  inches.  These  seating  arrangements  were 
chosen  to  promote  open  interaction  and  easy  communication 
between  the  group  members. 

The  large  group  trials  took  place  during  the  evening, 
with  similar  lighting  and  sound  levels  as  the  experimental 
room.  During  the  large  group  trials,  half  of  the  members 
sat  side  by  side,  along  one  wall  of  the  room,  while  the 
other  half  of  the  members  sat  on  the  other  side  of  the  room 
(approximately  ten  feet  away).  The  members  sitting  side  by 
side  were  separated  by  small  wooden  partitions  and  were 
approximately  24  inches  apart.  The  two  subsets  of  the  group 
had  their  backs  towards  each  other  with  the  server  computer 
on  one  side  of  the  room.  Again,  this  seating  arrangement 
was  chosen  over  other  possible  arrangements  to  promote 
discussion  and  make  for  the  best  achievable  interaction. 
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Procedure 

Each  subject  was  first  tested  individually,  in  order 
to  determine  the  baseline  performance  on  the  task.  After 
the  individual  testing,  subjects  were  divided  into  groups  of 
various  sizes  to  perform  the  group  task.  These  participants 
were  randomly  divided  to  form  one  group  of  eight  members, 
two  groups  of  four  members  and  two  groups  of  two  members. 
The  two  member  groups  were  rauidomly  chosen  from  the  four 
member  groups.  However,  the  male  subject  was  purposely 
excluded  from  the  group  of  two  observers  to  minimize  the 
chance  that  his  presence  would  bias  that  group's  decision 
(Clement  &  Schiereck,  1973).  The  large  group  consisted 
either  of  six  or  seven  members  due  to  absenteeism  and  sched¬ 
uling  problems.  All  subjects  were  retested  in  the  individu¬ 
al  task  at  the  end  of  the  study. 

Individual  Subject  Sessions 

The  subjects  were  instructed  to  respond  signal  or  noise 
on  each  trial  depending  on  the  height  of  the  stimuli  on  the 
nine  independent  gauges  relative  to  the  noise  and  signal 
mean  tick-marks.  The  subjects  were  asked  to  press  either 
the  "2"  key  for  noise  or  the  "3"  key  for  signal,  for  the 
representative  "noise"  and  "signal"  stimulus  display  screen. 

First,  each  subject's  individual  baseline  performance 
was  determined  through  several  individual  sessions.  A 
representative  trial  is  shown  in  Figure  3.  First,  a  0.5" 
by  0.5"  white  fixation  cross  was  presented  in  the  center  of 
the  display  for  200  ms.  Next,  the  nine  visual  display 


Trial  Sequence 


Fixation: 
200  ms 


Stimulus  Duration: 

370  ms  (initial  practice) 
320  ms  (test) 


Masking  Screen: 

200  ms 

Response  Duration: 
1000  ms 

Feedback : 

250  ms 


Figure  3.  Trial  sequence  for  i 


L 


Display  Screen 


White  Screen 


Blank  Screen 


Incorrect 


subject  testing. 
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gauges  were  presented  for  320  ms.  Immediately  after  the 
stimulus  display  screen,  a  200  ms  white  masking  screen  was 
presented.  Following  the  mask,  the  screen  was  completely 
blank  for  one  second  at  which  time  the  subject  could  press 
"2"  for  noise  or  "3"  for  signal.  If  an  answer  was  input 
before  or  after  the  allotted  one  second  response  period,  the 
response  was  discarded  and  "No  Response"  feedback  was  given. 
Finally,  the  observer  received  feedback  in  the  center  of  the 
screen  for  250  ms.  The  given  feedback  was  either  "Correct", 
"Incorrect",  or  "No  Response". 

Each  individual  subject  session  consisted  of  16  blocks 
of  125  trials  per  block  for  a  total  of  2000  trials  per 
session.  Four  difficulty  conditions  were  utilized  in  the 
current  study:  o  =  3.0,  a  =  2.5,  a  =  2.0,  and  a  =  1.5. 
Across  four  sessions,  each  subject  completed  2000  trials 
(1000  signal  and  1000  noise)  for  each  of  the  four  difficulty 
conditions.  All  subjects  received  two  practice  sessions 
with  a  370  ms  stimulus  duration.  In  addition,  seven  sub¬ 
jects  received  an  additional  two  to  four  practice  sessions 
with  a  320  ms  stimulus  duration.  However,  subject  Sy  re¬ 
ceived  only  the  initial  practice  sessions.  Furthermore,  Sy 
was  only  able  to  complete  three  sessions  for  a  total  of  1500 
trials  for  each  difficulty  condition  while  the  other  sub¬ 
jects  completed  2000  trials.  All  the  subjects  were  highly 
practiced  at  the  discrimination  task  prior  to  recording 


individual  data. 
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To  control  for  possible  practice  effects,  the  four 
difficulty  conditions  were  randomly  assigned  in  four  block 
combinations.  Each  subject  completed  four  blocks  of  each 
difficulty  during  a  session.  Across  sessions,  the  four 
block  sequences  were  also  randomized.  For  instance,  a 
session  could  occur  in  the  following  order;  Four  blocks  of 
trials  with  a  =  1.5,  four  blocks  of  trials  with  o  =  2.5, 
followed  by  four  blocks  with  a  =  2.0,  and  finally,  four 
blocks  with  a  =  3.0. 

The  subjects  were  instructed  to  take  breaks  after  each 
block  in  order  to  stay  attentive.  Each  experimental  session 
took  approximately  1.5  hours  to  complete. 

Group  Sessions 

After  the  individuals’  data  were  collected,  the  members 
were  tested  in  groups  of  two,  four,  and  eight  members.  The 
experimenter  instructed  the  groups  to  make  a  single  group 
response  for  each  of  the  trials.  In  order  to  allow  for  free 
interaction  among  group  members,  the  method  of  interaction 
and  decision  rule  was  not  specified  and  was  left  to  the 
separate  groups. 

During  a  group  trial,  each  subject  was  presented  with  a 
stimulus  display  screen,  representative  of  either  signal  or 
noise.  Figure  4  illustrates  an  example  of  a  group  trial. 
The  stimulus  displays  presented  to  the  groups  on  group 
trials  were  the  same  as  those  presented  on  individual  trials 
with  the  following  exceptions.  After  the  white  masking 
screen,  all  the  group  members'  computer  screens  were  com- 
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pletely  blank  for  700  ms.  This  blank  screen  period  was 
intended  to  signal  the  start  of  group  discussion  about  the 
trial.  Following  the  700  ms  pause,  one  of  the  group  members 
was  randomly  selected  and  signaled  on  her/his  computer 
screen  to  respond  for  the  group.  Unlike  the  individual 
trials,  no  time  limit  was  imposed  for  the  group  discussion 
and  interaction.  Therefore,  none  of  the  trials  were  dis¬ 
carded  as  "No  Response"  trials.  After  the  group  response,  a 
1000  Hz  tone  with  a  duration  of  150  ms  was  generated  by  the 
server  computer.  The  purpose  of  this  tone  was  to  inform  the 
members  that  a  group  response  had  been  made  and  to  focus 
their  attention  on  their  monitors.  At  that  time,  the  feed¬ 
back  was  presented  for  600  ms.  Feedback  on  the  group  trials 
included  the  group  response  in  addition  to  "Correct"  or 
"Incorrect".  The  experimenter  either  left  the  room  or  sat 
quietly  away  from  the  subjects  to  take  notes  about  the  group 
interaction.  The  subjects  could  not  see  what  the  experiment¬ 
er  was  working  on  during  their  interaction. 

Inter-member  correlation.  As  in  the  individual  condi¬ 
tions,  the  stimuli  presented  on  a  single  stimulus  display 
screen  (for  a  single  group  member)  were  always  made  up  of 
nine  independent,  normal  random  variables.  The  stimuli 
presented  on  the  stimulus  display  screens  (one  for  each 
group  member)  were  generated  by  a  process  that  allowed  the 
correlation  between  a  pair  of  group  member's  stimuli  to  be 
controlled.  The  stimuli  were  either  independent  (r  =  0.0) 
or  correlated  (r  =  0.25)  across  group  members. 


Responder 


Non-Responder 
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Trial  Sequence 


Fixation: 
200  ms 


+ 


Stimulus 

Duration: 

320  ms 


Masking  Screen; 
200  ms 


White  screen 


White  screen 


Start  of 
Interaction: 

700  ms 


Blank  screen 


Blank  screen 


Group  Responder 
Randomly  Chosen; 

after  700  ms 
of  blank  screen 


No  time  limit 
for  response 


Server  sounds 
tone  after 
response 


You  have  been 
selected  for  a 
response  station. 
Please  answer  the 
following  question 

Did  you  think  that 
was  signal  or  noise? 


Blank  screen 


Feedback; 
600  ms 


Response:  Noise 
Incorrect 


Response:  Noise 
Incorrect 


Figure  4.  An  example  of  the  synchronized  trial  sequence  for 
group  testing  (two-member  group  shown). 
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The  statistical  process  that  correlated  the  stimulus 
values  is  shown  in  Figure  5.  As  in  Sorkin  and  Montgomery 
(1991),  the  stimulus  values  for  a  spatially  positioned  gauge 
(1..9)  for  two  group  members  were  produced  by  combining 
three  independent,  normal  random  variables  X.^,  Xjj,  and  X^, 
where  =  pjj,  and  =  o^^,.  Where  o^^  is 

defined  as  the  unique  variance  and  is  defined  as  the 

common  or  shared  variance.  To  control  the  correlation 
between  the  stimuli  values  presented  on  the  first  gauge 
position  for  two  group  members,  we  form  the  two  values 
(Gi,i)  and  (62^ i).  These  values  are  produced  by  taking 
samples  of  the  random  variables  and  G2.  ^l,i  i 

are  defined  according  to  the  three  independent,  normal 
random  variables;  X^,  Xj,,  and  X^.  Let 

Gl,i  =  uXg  +  cXc  (16) 

^2,i  =  ^b  +  (17) 

Where 


E(Gi,i)  =  E(G2,i)  =  Pc 

and 


var(G2^i)  =  var(cX^)  +  var(uX3) 

=  c^o^^  +  =  (c2  + 

var(G2^i)  =  var(cX^)  +  var(uX3) 

=  c^a^^  +  u^a^jj  =  (c2  + 

Then,  the  correlation,  r,  between 


u2) 

u2) 

and  62^ i  is 


(18) 

(19) 


^Gl,i,G2,i  -  tco’^(Gi,i/G2,i)]/aGiOQ2/  (20) 

cov(G]^^  j^,G2^  i)  =  E[  (Gj^-pj)  (G2-P2)  ]  (21) 

=  E[(Gi^iG2^i  -  PlG2^i  -  ^2^2,1  +  ^1^2)^ 
assuming  noise  trials  where  P]^  and  P2  =  0, 
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=  E{cX^  +  u  X^)(cXj,  +  uXjj) 

=  E[c2Xj,2  +  u^XgXb  +  UX-^CX^  +  uX^cX^] 
since  the  distributions  are  independent 

=  E  [c^Xc^]  =  (22) 

then 


2rr2 


•G1,G2 


V(c^  +  u2)Oj,2  ^{c2  +  u2)aj,^ 

It  is  convenient  to  let 
c2  +  u2  =  1, 


C2  +  U' 


(23) 


(24) 


then 


c  =  Jr  and 


(25) 


u  =  J1  -  c^ . 


(26) 


In  Figure  5  the  stimulus  values  displayed  on  gauge  #1 
for  two  members  are  made  up  of  a  sample  of  a  shared  random 
variable  (X^)  and  samples  of  unique  random  variables  (X^  and 
Xjj).  From  the  equations  above,  stimulus  values  that  share  a 
large  portion  of  the  variance  (o^^)  are  more  likely  to  have 
similar  display  values  than  the  stimulus  values  that  have  no 
common  variance.  In  order  to  correlate  all  gauge  positions, 
the  same  process  was  repeated  for  each  gauge  {1..9).  Addi¬ 
tionally,  all  possible  pairs  of  members'  stimulus  values 
were  generated  in  the  same  manner  so  that  all  the  inter¬ 
member  correlations  could  be  controlled. 

The  statistical  process  correlated  each  like  spatially 
positioned  gauge  between  group  members  during  the  r  =  0.25 
condition.  During  the  r  =  0.0  condition,  the  stimulus 
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Group  member  1 ' s  stimulus  display  screen 
(1)  (2)  (3)  (4)  (5)  (6)  (7)  (8)  (9) 


sample 
from-  X 

sample 
from-  X 


a  = 


T 


T 


correlate  | 
gauge  #1 
across  members 


i 


I 

i 


correlate  each  gauge 
position  across 
members  I  I 


i 


sample 
from-  X> 

[G2,i] 
sample 
from-  X 


L 


(1)  (2)  (3)  (4)  (5)  (6)  (7)  (8)  (9) 

Group  member  2 ' s  stimulus  display  screen 


Figure  5.  Graphical  representation  of  how  stimulus  values 
presented  on  the  same  gauges  were  correlated  across 
group  members  during  the  r  =  0.25  condition  (trial  #1). 
Gauge  locations  are  labeled  in  parenthesis. 
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values  between  group  members  were  made  up  entirely  of  sam¬ 
ples  of  the  unique  random  variables.  In  this  manner,  the 
amount  of  shared  variance  was  experimentally  controlled. 
Since  each  gauge  position  across  each  pair  of  group  members 
was  correlated,  the  entire  group  members'  observations  were 
statistically  correlated.  The  inter-member  stimulus  corre¬ 
lation  was  verified  with  a  Monte  Carlo  simulation. 

Experimental  conditions  for  group  trials.  Each  experi¬ 
mental  session,  for  the  group  trials,  consisted  of  eight 
blocks  of  100  trials.  The  group  session  was  separated  into 
two,  four-block  sets,  with  the  same  condition  held  constant 
during  a  four-block  set.  In  order  to  account  for  possible 
practice  effects,  the  first  block  of  trials  for  each  new 
group  condition  was  labeled  practice  and  not  evaluated. 
During  the  equal  difficulty  distribution  trials,  all  group 
members  observed  stimulus  display  screens  with  the  same 
difficulty  (a)  condition.  For  group  trials,  the  specifica¬ 
tions  of  each  condition  consisted  of  an  inter-member  corre¬ 
lation  (r)  and  the  difficulty  level  (o)  for  each  group 
member.  Table  1  depicts  a  listing  of  all  the  trial  condi¬ 
tions.  The  stimuli  between  members  were  either  correlated 
(r  =  0.25)  or  independent  (r  =  0.0).  The  distribution  of 
difficulty  of  the  trials  across  group  members  was  either 
equal  or  unequal  and  is  listed  in  the  <  >.  Both  the  diffi¬ 
culty  and  correlation  aspects  of  the  trial  condition  were 
randomized  between  sets  and  across  sessions. 


Table 

Experimental  conditions  for 


Group 

Size 

Inter-member 
Correlation  (r) 

2 

0.00 

a 

0.25 

4 

0.00 

a 

a  : 

0.25 

a  : 

6 

0.00 

i 

1 

a  : 

i 

0.25 

7 

0.00 

o  ; 

0.25 
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group  trials. 


Difficulty  Distribution 
<a> 


Equal 
<1 . 5, 1 . 5> 
or 

<3.0,3.0> 


Equal 

<2. 0,2. 0,2.0, 2. 0> 
or 

<3. 0,3. 0,3.0, 3. 0> 


Unequal 

<1.5,1.5,3.0,3.0> 


Equal 

<2. 0,2. 0,2.0, 2. 0> 
or 

<3. 0,3. 0,3.0, 3. 0> 


Equal 

<2. 5, 2. 5, 2. 5, 2. 5, 2. 5, 2. 5> 

or 

<3. 0, 3. 0,3. 0,3. 0,3.0, 3. 0> 


Equal 

<2. 5, 2. 5, 2. 5, 2. 5, 2. 5, 2. 5, 2. 5> 

or 

<3. 0, 3. 0,3. 0,3. 0,3. 0,3.0, 3. 0> 
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The  number  of  replications  and  membership  for  the 
different  groups  are  listed  in  Table  2.  The  number  of 
100-trial  blocks  is  listed  in  parenthesis  after  the  group 
membership.  The  two  and  four  member  groups  completed  at 
least  two,  four-block  sets  (400  signal  trials  and  400  noise 
trials)  for  each  of  the  selected  trial  conditions.  The 
conditions  during  the  large  group  interaction  were  not 
replicated  with  the  same  exact  members  in  the  group  each 
time.  Depending  on  the  size  of  the  group,  some  of  the 
difficulty  conditions  were  omitted  because  the  group  per¬ 
formance  would  have  been  too  high  to  measure  accurately. 
The  groups  were  instructed  to  take  breaks  in  between  blocks 
to  stay  alert  and  attentive.  The  group  sessions,  similar  to 
the  individual  sessions,  took  approximately  1.5  hours  to 
complete . 

Unegual  difficulty  condition.  In  addition  to  the  equal 
difficulty  distribution  trials,  a  single  group  of  four 
subjects  completed  four,  four-block  sessions  where  the 
distribution  of  difficulty  (a)  of  trials,  across  the  sub¬ 
jects,  was  unequal.  During  a  set  of  four  blocks,  two  mem¬ 
bers  observed  stimulus  display  screens  with  small  variabili¬ 
ty  (a  =  1.5)  while  the  other  two  members  observed  stimulus 
display  screens  with  larger  variability  (a  =  3.0).  The 
different  difficulty  levels  of  the  task  were  randomly  as¬ 
signed  based  on  the  first  two  subjects  logged  in  and  were 
held  constant  for  each  four-block  set.  As  in  the  equal 
difficulty  trials,  an  unequal  difficulty  session  consisted 


Table  2. 

Group  membership  and  number  of  replications  for  group  trials 
in  all  experimental  conditions.  Number  of  blocks  for  each 
condition  are  listed  inside  of  parenthesis.  There  were  100 
trials  per  block.  All  groups  were  under  equal  difficulty  (a) 
distribution  except  the  four  member  group. 


2A.  2  Member  Groups 


Difficulty 


Inter-member  correlation  (r) 

0.0 

0.25 

Si  S2  (12) 

Si  S2  (8) 

S5  Sg  (8) 

S5  Sg  (8) 

Si  S2  (8) 

Si  S2  (8) 

S5  Sg  (8) 

S5  Sg  (8) 

<1.5/1. 5> 


<3.0/3.0> 


2B.  4  Member  Groups 


Difficulty 


Inter-member  correlation  (r) 


0.25 


EQUAL 

<2. 0,2. 0,2.0, 2. 0> 

Si  S2  S3  S4  (8) 

®5  ^6  ^8 

<3. 0,3. 0,3.0, 3. 0> 

Sf  S2  S3  S4  (8) 

S5  Sg  S7  Sg  (12) 

S7  Sg  S2  S5  (4) 

UNEQUAL 

<1.5,1.5,3.0,3.0> 

^2  ®5  ^7  ^8 

S5  S7  S2  Sg  (4) 
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Table  2  —  continued 

2C.  6  and  7  Member  Groups 


Difficulty 

Inter-member  correlation  (r) 

o 

0.0 

0.25 

<2.5, . . , 2 . 5> 

Si  S3  S5  Sg  S7  Sg 

Si  S2  S3  S5  Sg  S7  Sg 

Si  S2  S3  S4  S5  Sg  S7 

S2  S3  S4  S5  Sg  S7  Sg 

S2  S3  S4  Sg  S7  Sg 

<3.0, . . ,3.0> 

51  S3  S5  Sg  S7  Sg 

52  S3  S4  S5  Sg  S7  Sg 

S2  S3  S4  Sg  S7  Sg 

Si  S2  S3  S5  Sg  S7  Sg 

Si  S2  S3  S4  S5  Sg  S7 

All  conditions  listed  for  6  and  7  member  groups  are  based  on 
four  blocks  of  trials. 
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of  a  four-block  set  for  each  of  two  separate  conditions. 
Table  3  lists  the  six  possible  unequal  difficulty-subject 
combinations.  The  subjects  completed  a  four  block  set  for 
three  of  the  six  possible  subject-difficulty  combinations 
with  combination  #2  being  replicated. 

All  unequal  difficulty  distribution  trials  had  an 
inter-member  correlation  (r)  =  0.0.  The  same  instructions 
were  given  to  the  unequal  a  group  as  had  been  given  to  prior 
groups.  The  subjects  were  not  told  about  the  differences  in 
difficulty  across  subjects.  All  of  the  equal  difficulty 
trials  had  been  completed  prior  to  the  start  of  the  unequal 
difficulty  distribution  group. 

Individual  Retest 

After  the  equal  difficulty  group  trials,  the  subjects 
were  retested  in  the  four  difficulty  conditions.  The  goal 
of  this  retest  was  to  determine  whether  changes  in  individu¬ 
al  performance  (d'j^)  occurred  during  the  period  of  the  group 
trials.  The  individuals  were  tested  under  each  difficulty 
level  for  four  blocks  of  125  trials  per  block.  The  proce¬ 
dure  and  instructions  for  the  retest  were  the  same  as  the 
original  individual  trials. 


RESULTS 


This  section  begins  with  consideration  of  the  individu¬ 
al  performcince  (d'jL)  measured  before  the  group  trials  and 
during  a  subsequent  retest.  Next,  the  groups'  performance 
(d'grp)  analyzed  based  on  task  difficulty  (a),  the  number 
of  members  in  the  group  (m),  and  inter-member  correlation 
(r).  Consideration  of  these  three  effects  is  followed  by 
the  groups'  weighting  strategies  along  with  some  possible 
weighting  problems.  Finally,  an  analysis  of  the  groups' 
observed  ("obs^  weighting  ("weight^  efficiencies  is 
presented. 

Individual  Results 

During  the  individual  trial  sessions,  the  individual's 
responses  were  recorded,  along  with  the  presented  stimuli 
(signal  or  noise).  These  values  were  used  to  calculate  hit 
and  false  alarm  probabilities  for  a  block  of  125  trials. 
These  probabilities  were  then  transformed  to  a  measure  of 
the  individual's  detection  performance,  d' . 

The  mean  individual  performances  (d'j^),  across  the  four 
difficulty  levels,  are  listed  in  Table  4.  Performance  dif¬ 
ferences  between  subjects  were  not  significant  (F(4,8)=.348 
p<.923).  This  can  be  seen  in  Table  4,  as  performance  dif¬ 
ferences  due  to  the  difficulty  conditions  were  greater  than 
most  of  the  differences  between  individual  subjects. 
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Subject  performance  (d')  decreased  with  increases  in  diffi¬ 


culty  (a)  ( F( 4 , 8 ) =61 . 56  p<.001).  A  post-hoc  analysis 
(Tukey's  Test)  confirmed  that  all  the  difficulty  conditions 
were  significantly  different  (d'  decreased  with  each  in¬ 
crease  in  o,  p<.05).  There  was  no  significant  interaction 
between  difficulty  level  (a)  and  subject. 

The  ideal  performance  for  an  individual  subject, 
d' ideal'  within  each  of  the  difficulty  conditions  is  listed 
in  Table  5.  Since  the  stimulus  values  presented  on  each  of 
the  nine  gauges  were  independent  random  samples,  equation  27 


was  used  to  determine  d ' i^gai 


n  6_ 

d’ideal  =[2(— )‘] 
1  =  1  o 


1 


(27) 


Where  6i  refers  to  the  difference  between  the  means  of  the 
two  stimulus  distributions  (pg  -  p^);  in  this  study  it  is  a 
constant  equal  to  one.  Additionally,  refers  to  the 
standard  deviation  of  one  display  gauge.  The  values 
presented  in  Table  5  can  be  used  as  a  reference  to  determine 
how  actual  performance  (Table  4)  compared  to  ideal. 

The  subjects  performed  at  approximately  60%  efficiency 
levels  across  all  difficulty  conditions.  Average  efficien¬ 
cies  for  the  subjects  in  each  difficulty  condition  were 
determined  by  squaring  the  ratio  ( d ' obtained/^ ' ideal ^ 
(Tanner  &  Birdsall,  1958).  The  average  observed  efficiency 
("obs^  for  each  difficulty  level  was  :  59%  for  o=3.0,  61% 
for  0=2.5,  64%  for  a=2.0,  and  59%  for  0=1.5.  These  measures 
show  that  the  subjects  performed  at  approximately  the  same 


Table  4. 

Mean  performance  for  individual  subjects,  tested  prior 
to  group  trials,  under  the  four  different  difficulty  condi¬ 
tions.  There  were  125  trials  per  block,  with  values  based 
on  12  to  17  blocks.  The  average  performance  (d')  and  stan¬ 
dard  deviation  within  each  difficulty  condition,  across 
subjects,  is  listed  at  the  bottom  of  the  table.  The  average 
observed  efficiency  ("obs^'  across  subjects,  for  each  diffi¬ 
culty  level  is  also  listed. 


Difficulty  Level  (Oj^)  (decreasing  ->) 


Subject 

(3.0) 

(2.5) 

(2.0) 

(1.5) 

Si 

0.83 

0.99 

1.36 

1.57 

S2 

0.82 

1.03 

1.45 

1.60 

S3 

0.71 

0.90 

1.12 

1.32 

S4 

0.66 

0.90 

1.21 

1.62 

S5 

0.74 

0.91 

1.12 

1.64 

S6 

0.67 

0.81 

1.07 

1.34 

S7 

0.92 

1.06 

1.26 

1.69 

S8 

0.69 

0.91 

0.98 

1.47 

Average  ( d ' ) 

Performance  0.76  0.94  1.20  1.53 

Standard 

Deviation  0.092  0.082  0.156  0.139 

Average  ("obs) 

Efficiency 
Across 

Subjects  0.59 


0.61 


0.64 


0.59 
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Table  5. 

The  four  difficulty  conditions  used  during  the  individual 
and  group  trials.  ‘^'ide?il  given  for  the  optimal  perform¬ 

er  during  individual  trials.  During  the  individual  trials, 
the  sources  of  information  (gauges)  were  always  independent 
and  therefore  the  optimum  individual  performance  with  n 
gauges  is: 

n  6i  6 

d' ideal  =  - )  1*  =  —  (1)  .Sr 

i=l  o 

Since  the  trials  consisted  of  nine  gauges  and  6  =  (pg  -  Pjj) 
is  a  constant  =  1,  d' ideal  "  (3)(l/aj^). 


Difficulty  Level  (decreasing  -») 


Standard 

deviation 

^i 

B 

2.5 

o 

• 

CM 

1.5 

ideal 

1.0 

1.2 

1.5 

2.0 
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efficiency  level  across  the  difficulty  conditions.  They 
also  show  that  the  subjects  were  able  to  effectively  utilize 
the  information  on  the  gauges  to  perform  the  signal  detec¬ 
tion  task. 

Individual  Retest 

Following  the  equal  a  group  trials,  the  individual 
subjects  were  retested  under  the  four  different  difficulty 
(o)  conditions,  in  order  to  determine  if  individual  perfor¬ 
mance  (d'j^)  changed  during  the  group  trials.  The  retest 
session  consisted  of  a  four-block  set  for  each  of  the  four 
difficulty  conditions,  presented  in  random  order. 

The  differences  between  mean  individual  performance 
prior  to  and  after  the  group  trials  (measured  in  d')  are 
shown  in  Table  6.  Individual  performance  on  the  retest  was 
approximately  the  same  as  measured  on  the  pre-group  trials, 
(mean  cell  change  =  0.04).  The  retest  showed  that  there  was 
no  significant  change  in  individual  d'  values  from  the 
pre-group  trials  to  the  retest  (F( 1,48) =.246  p<.622).  There 
was  no  significant  difference  between  any  of  the  subjects  in 
the  retest  (F( 7, 48) =.631  p<.728),  and  the  interaction  bet¬ 
ween  subjects  and  time  of  test  (F( 7, 48) =.224  p<.978)  was  not 
significant. 

Group  Results 

During  each  group  trial,  the  sum  of  the  stimulus  gauge 
values  presented  on  a  display  screen  for  each  subject,  the 
group  response,  and  the  stimulus  (signal  or  noise),  were 
recorded.  The  latter  two  values  were  then  used  to  determine 
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Table  6. 

Change  in  mean  individual  performance  (d'j^)  compared  to 
original  individual  performance  (Table  4)  measured  at  the  end 
of  the  group  trials.  There  were  125  trials  per  block,  with 
retest  values  based  on  4  blocks.  A  decline  in  performance  on 
the  retest  is  indicated  by  (-). 


Difficulty  Level  (a^^)  (decreasing  -*) 

Mean  Subject 
Change 

-.085 

+  .173 

+  .110 

-.150 

-.015 

+  .108 

+  .053 

+  .130 

+  .040 
Mean 
Cell 
Change 


Sub j  ect 

(3.0) 

(2.5) 

(2.0) 

(1.5) 

mm 

.15 

-.01 

-.16 

-.04 

S2 

.22 

.33 

-.33 

.21 

S3 

.22 

.18 

-.06 

.10 

S4 

.20 

.11 

.03 

.18 

S5 

-.06 

-.19 

-.07 

-.28 

Se 

-.05 

.14 

-.04 

.16 

S7 

-.12 

-.07 

.03 

-.18 

Ss 

.18 

.08 

.25 

.18 

Mean  +.093  +.073  -.044  +.041 

Difficulty 

Change 
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hit  and  false  alarm  rates.  The  hit  and  false  alarm  rates 
were  then  transformed  into  detection  performance  for  the 
group  (d'grp)*  average  group  performance  (d'gj-p)  for 
each  trial  condition  is  listed  in  Tables  7  and  8.  Each 
group  completed  two,  four-block  sets  during  each  experimen¬ 
tal  session.  The  experimental  conditions  (difficulty  (a) 
and  inter-member  correlation  (r))  were  presented  in  random 
order  and  held  constant  for  each  four-block  set.  The  values 
for  two  and  four-member  groups  are  averages  for  two  groups 
that  completed  at  least  800  trials  for  each  difficulty 
condition.  However,  the  d'g^-p  listed  for  the  six  and  seven- 
member  groups  are  based  on  400  trials  or  the  average  of  two 
groups  that  completed  400  trials  each. 

Group  performance  (d'g^-p)  increased  with  number  of 
group  members  (m),  and  decreased  both  with  inter-member 
correlation  (r)  and  difficulty  (a)  of  the  conditions.  These 
effects  of  m,  r,  and  a  on  group  performance  (d'g^-p)  are 
shown  in  Figures  6  and  7.  The  difficulty  level  of  the 
conditions  (a)  is  along  the  x  axis  and  d'gj-p  is  plotted 
vertically,  with  data  point  labels  representing  the  number 
of  members  in  the  group  (m).  Figure  6  shows  the  performance 
(d'grp)  for  all  group  conditions  with  inter-member  correla¬ 
tion  (r)  =  0.0,  and  Figure  7  shows  the  performance  (d'grp) 
for  r  =  0.25. 

Task  Difficulty  (o) 

Similar  to  the  effect  seen  in  individual  performance, 
the  difficulty  level  (a)  had  a  negative  effect  on  group 
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Table  7. 

Average  group  performance  (d'  j._j)  for  each  experimental 
condition,  with  groups  of  two  four  members.  There  were 
100  trials  per  block,  with  values  based  on  16  to  20  blocks. 
The  unequal  o  condition  was  based  on  4  and  8  blocks. 


Group 

Members 

#  in 
Group 

Correlation 

(r) 

Difficulty 

Distribution 

Difficulty 

Condition 

d'grp  (CT) 

Si  S2 

OR 

S5  S6 

2 

0.0 

Equal 

0=3.0 

1.02  (.33) 

0.0 

Equal 

0=1.5 

2.17  (.23) 

0.25 

Equal 

0.97  (.29) 

0.25 

Equal 

0=1.5 

1.94  (.22) 

Si  S2 
S3  S4 

OR 

S7  S8 

4 

0.0 

Equal 

0=3.0 

1.24  (.30) 

0.0 

Equal 

0=2.0 

1.97  (.37) 

0.25 

Equal 

0=3.0 

0.99  (.16) 

0.25 

Equal 

0=2.0 

1.61  (.24) 

S7  Sq 

^2  S5 

4 

0.0 

Unequal 

0=1.5 

1.95  (.36) 

0.0 

Unequal 

0=3.0 

^2  S5 

S7  S8 

4 

0.0 

Unequal 

0=1.5 

1.48  (.19) 

0.0 

Unequal 

0=3.0 

S5  S7 

^2  ^8 

4 

0.0 

Unequal 

0=1.5 

1.69  (.16) 

0.0 

Unequal 

0=3 . 0 
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Table  8. 

Average  group  performance  for  each  experimental 
condition,  with  groups  of  six  and  seven  members.  There  were 
100  trials  per  block,  with  values  based  on  4  or  8  blocks. 
The  values  for  the  8  block  conditions  are  the  average  for  two 
groups  with  different  membership. 


#  in 
Group 

Correlation 

(r) 

Difficulty 

Distribution 

Difficulty 

Condition 

d'grp  (^) 

#  of 
Blocks 

6 

0.0 

Equal 

0=3.0 

1.19  (.31) 

8 

6 

0.0 

Equal 

irai 

1.62  (.32) 

4 

6 

0.25 

Equal 

■aa 

1.46  (.25) 

4 

7 

0.0 

Equal 

I^B 

1.57  (.24) 

8 

mm 

0.25 

Equal 

0=3 . 0 

1.19  (.28) 

8 

a 

0.0 

Equal 

0=3.0 

1.37  (.40) 

4 

B 

0.25 

_ 

Equal 

0=2 . 5 

1.70  (.35) 

4 

Difficulty  Level 


Figure  6.  The  group  performance  (d'gj.p)  plotted  against 

difficulty  level  (a)  of  the  trials.  These  values  are  for 
conditions  with  inter-member  correlation  (r)=0.0.  The 
data  point  labels  are  the  number  of  members  in  the  group 
(m) .  The  error  bars  represent  one  standard  deviation 
each  side  for  the  average  of  eight  values  for  m=l  and 
all  block  values  (19  and  16  blocks,  respectively)  for 


Difficulty  Level 


Figure  7.  The  group  performance  (d'grp)  plotted  against 

difficulty  level  (a)  of  the  trials.  These  values  are 
for  conditions  with  inter-member  correlation  (r)=0.25. 
The  data  point  labels  are  the  number  of  members  in  the 
group  (m) .  The  error  bars  represent  one  standard  devia¬ 
tion  each  side  for  the  average  of  16  and  20  blocks, 
respectively . 
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performance  (d'gj-p).  This  can  clearly  be  seen  in  Table  7, 
which  lists  the  mean  performance  of  the  two-member  groups, 
and  in  Figures  6  and  7.  For  each  size  group  (m),  d'g^-p 
decreased  as  the  difficulty  (a)  of  the  trials  increased. 
The  effect  of  difficulty  (a)  on  group  performance  (d'gj.p) 
was  significant  in  all  of  the  two  and  four  member,  r  combi¬ 
nations  ((m=2,r=0  F ( 1 , 33 ) =135 . 25  p<.001)  (m=2,r=.25 
F{1,34)=113.45  p<.001)  (m=4,r  =  0  F(  1 , 34 ) =38 . 80  p<.001) 
(m=4,r=.25  F(l,32)=75.94  p<.001)).  The  effect  of  o  on  d'gj-p 
in  six  and  seven  member  groups  did  not  reach  statistical 
significance  ((m=6,r=0  F(l,10)=4.26  p<.066)  (m=7,r=0 
F(l,10)=1.04  p<.332)  (m=7,r=.25  F{1,10)=6.03  p<.034)). 
Number  of  Group  Members  (m) 

Group  performance  (<3 'grp)  increased  with  increases  in 
the  number  of  group  members  (m) .  For  example.  Table  7  shows 
that  in  the  a  =  3.0  and  r  =  0.0  condition,  the  average 
performance  (d'grp)  for  the  groups  with  two  members  (S]^  S2  & 
S5  Sg)  was  =  1.02  and  the  groups  of  four  (Sj  S2  S3  S4  &  S5 
Sg  S7  Sg)  had  an  average  d'g^-p  =  1.24.  Figures  6  and  7 
graphically  depict  the  increase  in  d'gj.p  as  the  number  of 
group  members  (m)  increases.  This  effect  is  fairly  consist¬ 
ent  in  Figure  6  and  can  also  be  seen  in  Figure  8. 

Figure  8  shows  group  performance  plotted  as  a  function 
of  m  and  inter-member  correlation  (r),  in  the  only  difficul¬ 
ty  condition  common  to  several  different  group  sizes 
(a=3.0).  The  filled  circle  on  the  far  left  of  the  graph 
represents  the  average  individual  performance  for  all  eight 
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subjects.  The  other  plotted  points  represent  the  average  of 
two  groups  over  8  blocks  for  each  two  or  four-member  group 
and  4  blocks  for  each  six  and  seven-member  group.  The 
error  bars  plotted  for  the  individual  performance  are  based 
on  the  average  for  all  the  individual  subject's  performance 
(average  of  8  values).  The  error  bars  for  the  group  perfor¬ 
mance  are  based  on  4  or  8  block  values  for  six  and  seven- 
member  groups  and  16  to  20  values  for  the  two  and  four- 
member  groups.  Only  one  side  of  the  error  bars  were  plotted 
to  avoid  overlapping  lines.  Within  the  r=0.0  condition,  the 
positive  effect  of  m  on  performance,  was  significant 
(F( 4, 51) =4. 56,  p<.003).  A  post-hoc  (Tukey's)  test  showed 
that  the  individual  performance  was  significantly  less  than 
the  four  and  seven-member  groups  {p<.05)  and  was  marginally 
less  than  the  six-member  group  (p<.06).  Within  the  r=0.25 
condition,  the  increase  in  group  performance  due  to  increas¬ 
ing  the  number  of  group  members  from  m=2  to  m=7  did  not 
reach  significance  (F(2,43)=2.39,  p<.103). 

Inter-member  Correlation  (r) 

The  effect  of  inter-member  correlation  (r)  on  group 
performance  is  also  apparent  in  Figure  8  since  the  r  =  0.0 
curve  is  consistently  higher  than  the  r  =  0.25  curve. 
The  d'gj.p  values  for  the  a=3.0  condition  (all  groups) 
showed  that  inter-member  correlation  (r)  had  a  significant 
(F(l,92)=6.276,  p<.01)  negative  effect  on  group  performance. 
This  effect  can  also  be  seen  by  comparing  Figure  6  (r=0.0) 
to  Figure  7  (r=0.25). 


Number  of  subjects  in  group  (m) 


Figure  8.  Best  fit  lines  for  the  (o)=3.0  condition.  The 

correction  from  the  ideal  predictions  to  actual  perfor¬ 
mance  is  inversely  proportional  to  the  nximber  of  group 
members  and  is  described  in  the  text.  The  number  of 
group  members  (m)  is  along  the  x  axis  and  d'  along  the  y 
axis.  The  solid  circles  represent  the  independent 
{r=0.0)  condition,  and  the  open  dicunonds  represent  the 
correlated  {r=0.25)  condition.  The  error  bars  represent 
one  standard  deviation  with  the  values  based  on  4  or  8 
blocks  in  m=6,  m=7  or  16-20  blocks  for  the  m=2,  m=4 

groups . 
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Group  performance  fit  to  ideal  model.  The  smooth  func¬ 
tions  in  Figure  8  were  calculated  using  a  least  squares  fit 
(Scientist  Plot)  of  the  data  to  equation  6  (Sorkin  &  Dai, 
1994),  and  assuming  an  additional  source  of  noise,  o^q. 
Performance  was  fit  to  the  following  equation: 

1  i  m  Var  (d' )  in  (d*  )2  i 

^'arv  =[ - 1  t -  +  - ]  (28) 

1  +  m  a^Q  1  -  r  1  +  r  (m-1)  . 

Where  m  is  the  number  of  group  members  and  o^q  represents 
the  additional  noise  source.  The  second  part  of  the  equa¬ 
tion  is  the  original  ideal  group  equation,  given  in  equation 
6  (Sorkin  &  Dai,  1994).  The  effect  of  the  additional  noise 
is  to  reduce  performance  somewhat  as  the  group  size  in¬ 
creases.  In  this  fit,  a^g  =  0.20. 

Group  Weighting  Strategy 

In  order  to  determine  the  relative  weights  assigned  to 
each  member  during  the  group  process,  Lutfi's  (in  press) 
correlational  weighting  analysis  was  utilized.  The  proce¬ 
dure  used  to  derive  the  relative  weights  is  based  on  the 
point-biserial  correlation  between  the  stimulus  presented  to 
each  group  member  and  the  group  response,  scaled  by  the 
variability  of  the  presented  information.  The  weighting 
procedure  is  explained  in  the  Appendix.  Equation  9  (from 
Sorkin  &  Dai,  1994),  described  earlier,  was  used  to  deter¬ 
mine  the  ideal  weights  for  each  member  depending  on  their 
individual  performance  and  the  trial  condition.  The  actual 
relative  weights  and  the  ideal  weights  are  shown  in  Figures 
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9  through  16,  with  the  relative  weights  represented  by  the 
open  bars  and  the  ideal  weights  represented  by  the  hashed 
bars. 

The  unequal  a  conditions  show  that  the  groups  can 
differentiate  differences  in  individual  performance  and 
assign  weights  that  are  similar  to  ideal.  For  example,  in 
the  unequal  o  group  trials  shown  in  Figure  13,  the  group 
members  that  received  information  that  was  difficult  to 
discriminate  (a=3.0),  clearly  received  less  weight  than  the 
other  two  group  members.  All  three  subject-difficulty 
combinations  tested  show  this  effect. 

The  weights  assigned  during  the  equal  o  condition 
trials  appear  to  be  somewhat  variable.  The  weights  do  not 
appear  to  follow  a  specific  pattern,  but  the  differences  in 
individual  performance  are  very  small  to  begin  with. 

However,  there  were  clearly  some  deviations  from  a 
weighting  strategy  based  on  individual  performance.  An 
example  of  this  is  depicted  in  the  negative  weighting  of  S4 
on  Figure  16.  S4  forced  her  group  to  wait  for  her  because 
she  was  late  for  two  consecutive  experimental  sessions. 
This  seems  to  have  had  a  negative  effect  on  the  relative 
weight  that  the  group  assigned  to  her. 

Differences  Between  Actual  and  Ideal  Weights 

In  order  to  test  the  effectiveness  of  the  group  weight¬ 
ing  strategy,  we  tested  the  significance  of  the  difference 
between  actual  and  ideal  weights.  First,  the  correlations 
between  each  group  members'  stimuli  (sum  of  stimulus  gauges) 


Average  Wel^its  Average 
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Figure  9.  The  relative  weights  for  a  two-member  group.  The 
average  relative  weight  is  represented  by  the  open  bar 
and  the  ideal  weights  are  represented  by  the  hashed  bar. 
A  represents  the  (o)=1.5,  r=0.0  condition,  B  represents 
the  (o)=1.5,  r=.25  condition,  C  represents  the  (a) =3.0, 
r=0.0  condition,  and  D  represents  the  (a) =3.0,  r=.25 

condition.  The  S-  symbol  represents  the  signal  trials 
and  the  N-  symbol  represents  the  noise  trials  (400-600 
each) . 
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Figure  10.  The  relative  weights  for  a  two-member  group.  The 
average  relative  weight  is  represented  by  the  open  bar 
and  the  ideal  weights  are  represented  by  the  hashed  bar. 
A  represents  the  (a) =1.5,  r=0.0  condition,  B  represents 
the  (a)=1.5,  r=.25  condition,  C  represents  the  (a)=3.0, 
r=0.0  condition,  and  D  represents  the  (a)=3.0,  r=.25 

condition.  The  S-  symbol  represents  the  signal  trials 
and  the  N-  symbol  represents  the  noise  trials  (400-600 
each) . 
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Figure  11.  The  relative  weights  for  a  four-member  group. 
The  average  relative  weight  is  represented  by  the  open 
bar  and  the  ideal  weights  are  represented  by  the  hashed 
bar.  A  represents  the  (a) =2.0,  r=0.0  condition,  B 

represents  the  (a) =2.0,  r=0.25  condition,  C  represents 
the  (a) =3.0,  r=0.0  condition,  and  D  represents  the 

(a)=3.0,  r=0.25  condition.  The  S-  symbol  represents  the 
signal  trials  and  the  N-  symbol  represents  the  noise 
trials  (400  each). 
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Figure  12.  The  relative  weights  for  a  four-member  group. 
The  average  relative  weight  is  represented  by  the  open 
bar  and  the  ideal  weights  are  represented  by  the  hashed 
bar.  A  represents  the  (a)=2.0,  r=0.0  condition,  B 

represents  the  (a) =2.0,  r=0.25  condition,  C  represents 
the  {o)=3.0,  r=0.0  condition,  and  D  represents  the 

(a) =3.0,  r=0.25  condition.  The  S-  symbol  represents  the 
signal  trials  and  the  N-  symbol  represents  the  noise 
trials  (400  each). 


Figure  13.  The  relative  weights  for  a  four-member  group 
under  the  unequal  difficulty  (a)  condition.  A  and  C  are 
based  on  400  trials  and  B  is  based  on  800  trials.  The 
S-  symbol  represents  the  signal  trials  and  N-  represents 
the  noise  trials.  The  standard  deviation  (difficulty) 
of  the  presented  stimuli  distributions  (single  gauge) 
are  listed  beneath  the  subject  number. 


Average  WSfitils  Ayffage  v\ei^ts 


SuOtect  Number 


Subject  Number 


Subject  Number 


Subject  Number 


Figure  14.  The  relative  weights  for  a  six-member  group.  The 
average  relative  weights  are  represented  by  the  open  bar 
and  the  ideal  weights  are  represented  by  the  hashed  bar. 
A  represents  the  (a) =2. 5,  r=0.0  condition,  B  represents 
the  (a)=3.0,  r=0.0  condition,  C  represents  the  {a)=2.5, 
r=0.25  condition,  and  D  represents  the  (a) =3.0,  r=0.25 

condition.  The  S-  symbol  represents  the  signal  trials 
and  the  N-  symbol  represents  the  noise  trials.  Each 
graph  is  based  on  400  trials. 
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Figure  15.  The  relative  weights  for  a  seven-member  group. 
The  average  relative  weights  are  represented  by  the  open 
bar  and  the  ideal  weights  are  represented  by  the  hashed 
bar.  A  represents  the  (a) =2. 5,  r=0.0  condition,  B 

represents  the  (a) =3.0,  r=0.25  condition,  C  represents 
the  {a)=2.5,  r=0.25  condition,  and  D  represents  the 

(a) =3.0,  r=0.0  condition.  The  S-  symbol  represents  the 

signal  trials  and  the  N-  symbol  represents  the  noise 
trials.  Each  graph  is  based  on  400  trials. 
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Figure  16.  The  relative  weights  for  a  seven-member  group. 
The  average  relative  weights  are  represented  by  the  open 
bar  and  the  ideal  weights  are  represented  by  the  hashed 
bar.  A  represents  the  (a)=3.0,  r=0.25  condition,  and  B 
represents  the  (a) =2. 5,  r=0.0  condition.  The  S-  symbol 
represents  the  signal  trials  and  the  N-  symbol  repre¬ 
sents  the  noise  trials.  Each  graph  is  based  on  400 
trials  . 
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and  the  group  response  were  calculated.  These  correlations 
were  then  converted  to  relative  weights  (Appendix).  Ideal 
weights  (Sj^)  were  derived  by  using  equation  9. 

In  order  to  determine  if  the  relative  weights  (aj^)  were 
statistically  different  from  the  ideal  weights,  a  99%  con¬ 
fidence  interval  around  the  relative  weight  was  formed. 

a^  ±  2.575(0^^)  (29) 

The  standard  deviation  of  the  actual  weights  (t^ai^ 
determined  as  follows:  First,  the  correlations  between  the 
s\im  of  the  stimulus  displays  and  the  group  response  (rpjj^^) 
were  transformed  into  Fisher's  Z  scores  (Z^). 

1  +  r 

Zj.  =  (1/2)  logg  [ - ]  (30) 

1  "  ^Rxi 

The  Fisher's  Z  has  an  estimated  standard  error  (02^.)=  l/Vn-3 
for  standard  correlations.  [When  the  assumption  of  independ¬ 
ent  information  sources  is  violated  (i.e.  r  =.25),  partial 
correlations  can  be  utilized.  The  estimated  standard  error 
of  Z  is  equal  to  l/Vn-4 ,  or  l/^n- ( m+3 )  for  higher  order 
correlations,  where  n  is  the  number  of  trials  and  m  is  the 
number  of  variables  being  partialled  out  (Thorndike,  1978)]. 
Next,  the  ratio  (^zr^/^rRxi  equal  to  (Oj.R3ji)/^Rxi 

order  to  determine  an  estimated  standard  deviation  of  the 
correlation  (cf^-Rxi)* 

^Zr  ^rRxi 

-  =  -  (31) 

^rRxi  ^Rxi 

Given  that  the  relative  weights  (a^),  (in  the  equal  diffi¬ 
culty  condition)  can  be  thought  of  as  the  stimulus-response 
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correlation  (rjjxi^  times  a  scaling  constant,  the  equality 
given  in  equation  32  was  used  to  determine  o-^^ . 

°ai  ^rRxi 


(32) 


^i  ^Rxi 

These  tests  showed  =  .035  -  .065. 


Examination  of  all  the  group  conditions,  within  the 
equal  difficulty  condition,  showed  5  out  of  a  possible  29 
conditions  where  the  groups  assigned  a  weight  that  was 
significantly  different  than  ideal  (p<.01).  It  was  inter¬ 
esting  that  S2  was  weighted  significantly  less  than  ideal  on 
two  out  of  four  conditions  in  the  four  member  group  (a=2.0, 
r=0  and  r=.25.  Figure  11  A  &  B)  and  once  in  the  two-member 
group  (0=1.5,  r=0.0.  Figure  9  A).  The  weights  in  the  une¬ 
qual  difficulty  condition  (Figure  13)  showed  very  small 
variations  from  ideal  weights;  none  exceeded  the  criterion. 
These  findings  show  that  the  unequal  o  condition  displayed 
nearly  ideal  weights  cind  the  equal  a  condition  displayed 
weights  that  were  more  variable  but  not  drastically  differ¬ 
ent  from  ideal. 

To  be  sure  that  the  weighting  test  described  above  was 
appropriate,  a  Monte  Carlo  simulation  was  conducted.  The 
simulation  used  a  group  of  four  members  in  a  trial  where  the 
ideal  weights  were  equal.  The  simulated  group  decision 
statistic  (Z  from  Figure  1)  was  based  on  equal  weighting  of 
all  members  and  the  criterion  (Z^)  was  placed  midway  between 
signal  and  noise  means.  The  s\im  of  the  stimulus  displays 
for  each  group  member  and  the  group  response  were  recorded. 
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The  simulated  trials  were  then  separated  and  analyzed  in 
signal  and  noise  trials.  The  trials  were  analyzed  according 
to  Lutfi's  correlational  analysis  (Appendix)  in  order  to 
determine  the  simulated  ideal  weights.  The  mean  and  stan¬ 
dard  deviation  of  a  single  "ideal  member's"  normalized 
weight  based  on  500  blocks  with  100  trials  per  block 
was  .257  and  .08  respectively.  Therefore,  the  estimated 
standard  error  of  aj^  is 


.08 


where  n  is  the  number  of  blocks  of  trials.  This  value  (.04 
for  four  trial  blocks)  was  very  similar  to  the  values 
(.035  -  .065)  calculated  in  equation  32.  Consequently,  it 
can  be  concluded  that  the  method  of  testing  the  relative 
weights,  described  earlier,  was  appropriate. 

Weights  When  Group  Responder  versus  Non-responder 

The  effect  of  being  the  responder  for  the  group  was  examined 
by  evaluating  a  representative  four-member  (S]^  -  S4)  group's 
performance  under  the  o=2.0,  r=0.0  condition.  Within  noise 
or  signal  trials,  the  correlations  between  each  subject's 
stimulus  (sum  of  the  presented  stimulus  gauge  values)  and 
the  group  response  were  calculated  for  two  cases.  The 
correlations  were  calculated  for  trials  when  she/he  respond¬ 
ed  for  the  group  and  for  those  when  she/he  was  a  non¬ 
responding  member  of  the  group.  In  the  equal  a  condition, 
these  correlations  are  proportional  to  the  relative  weights. 
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The  relative  weight  for  a  subject  was  consistently 
higher  when  she/he  responded  for  the  group  compared  to  when 
the  subject  did  not  respond.  This  can  be  seen  in  Figure  17. 
The  weights  shown  in  Figure  17  represent  each  subjects' 
relative  weight  when  assigned  to  be  a  responder  (open  bar) 
and  non-responder  (hashed  bar)  under  signal  and  noise  tri¬ 
als.  The  error  bars  represent  estimates  of  the  standard 
error  of  the  mean,  Vl/n-3.  Where  n  represents  the  number  of 
trials . 

The  correlations  were  converted  into  Z-values  using 
Fisher's  Z  transformation  (equation  30).  The  differences 
between  these  values  were  then  used  to  determine  if  the 
members'  relative  weights  were  different  when  they  responded 
for  the  group  than  when  they  did  not  respond  for  the  group. 
Since  the  number  of  trials  was  different  for  each  case 
(approximately  100  responder,  300  non-responder),  the  form 
of  the  test  was: 

^responder  “  ^non- responder  (34) 

Vl/{nresponder  ^/^*^non- responder  • 

Where  the  Z  values  are  for  a  single  subject  (Thorndike, 
1978).  Since  it  is  possible  that  the  group  assigned  less  or 
more  weight  to  the  responder,  a  two-tail  95%  confidence 
interval  was  used  to  determine  if  the  correlations  were 
significantly  different.  Although  all  of  the  eight  tests 
showed  that  more  weight  was  assigned  to  the  subject  when 
acting  as  a  responder  versus  a  non- responder ,  none  of  these 
were  statistically  significant  (p>.05). 


Relative  Weight  Relafive  Weight 


Figure  17.  Relative  weights  assigned  to  members  of  a  four- 
member  group  when  chosen  to  respond  for  the  group  (open 
bar)  and  when  a  non-responder  (hashed  bar).  The  weights 
are  based  on  approximately  400  trials  for  both  signal 
and  noise  trials  divided  into  approximately  100  trails 
as  responder  and  300  trials  when  non- responder .  The 
group  condition  (a=2.0,  r=0.0)  was  randomly  selected  as 
a  representative  example.  The  error  bars  represent  the 
estimated  standard  error  of  the  mean  for  Vl/n-S . 
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Notes  on  member's  int:eraction  tendencies.  One  possibil¬ 
ity  for  some  of  the  deviations  from  ideal  weights  is  that 
the  groups  used  one  or  more  social  attributes  as  weighting 
criteria.  During  the  group  trials,  several  of  the  group 
interactions  were  monitored  by  the  experimenter.  Table  9 
depicts  the  tendencies  for  individual  subjects  to  interact 
during  the  group  trials,  based  on  notes  taken  during  these 
interactions.  This  is  a  somewhat  subjective  measurement  but 
it  may  account  for  the  consistent  lower  relative  weights 
assigned  to  S2  even  though  she  was  one  of  the  best  individu¬ 
al  performers. 

On  the  opposite  end  of  Table  9,  Sg  was  highly  interac¬ 
tive.  Sg  received  weights  slightly  larger  than  ideal  on  all 
trial  conditions  in  all  of  the  four-member  group  interac¬ 
tions  in  which  she  participated.  These  examples  suggest 
that  social  factors  may  have  affected  the  relative  weights 
assigned  to  individual  subjects  during  the  group  decision 
process . 

Efficiency  of  Group  Performance  Across  Conditions 

Groups  performed  relatively  effectively  across  trial 
conditions.  However,  their  performance,  relative  to  the 
ideal,  tended  to  decrease  as  m  increased.  Figure  18  shows 
the  obtained  group  performance  (d'grp)  plotted  against  ideal 
group  performance  (d' ideal  ^  ^  ^  conditions. 
The  numbers  plotted  on  the  figure  indicate  the  size  of  the 


groups . 
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Table  9. 

Individual  group  member's  tendencies  toward  interacting 
during  group  interaction.  These  tendencies  were  estimated 
from  experimenter's  notes  taken  during  group  interaction. 


Interaction  Tendencies 


Group 
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As  m  increases,  the  distance  from  ideal  performamce 
(major  diagonal)  appears  to  increase.  The  groups  appear  to 
be  clustered  equidistant  from  the  diagonal  based  on  the 
group  size.  For  example,  the  two-member  groups  are  all  very 
close  to  the  diagonal.  The  four-member  groups  are  farther 
away  from  the  diagonal  but  are  all  approximately  the  same 
distance  from  the  diagonal.  The  six-member  and  seven-member 
groups  are  consistently  the  farthest  from  the  diagonal.  The 
only  exceptions  were  two  of  the  unequal  o  (4U)  group  condi¬ 
tions;  these  were  similar  to  the  larger  groups  in  their 
relative  perf ormcince . 

Group  Efficiencies  (^weight  and  *^obs) 

The  group  observed  efficiencies  ("obs^  relative 

weighting  efficiencies  ("weight^  group  conditions 

are  listed  in  Tables  10  and  11.  Overall  efficiency  ("obs^ 
was  obtained  by  squaring  the  ratio  d  ’  obtained/*^  ’  Ideal  Group 
(Tanner  &  Birdsall,  1958),  while  weighting  efficiency 
("weight^  was  obtained  by  squaring  the  ratio 

^ 'weight/^ ' Ideal  Group  1991).  The  value 

assumes  ideal  group  performance  except  it  utilizes  the 
actual  weights  (aj^)  assigned  by  the  groups. 

Overall  efficiency  ("obs^  equal  a  conditions 

decreased  (F(3,22)=6.615  p<.002)  with  group  size  (m) .  A 
post-hoc  analysis  (Tukey's  test),  showed  that  the  efficiency 
of  the  two-member  groups  was  significantly  higher  than  all 
the  other  groups  (p<.05).  Group  weighting  efficiency  was 
high  across  all  conditions,  but  marginally  decreased  from 
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in=l  to  in=7  ( F( 4, 26 )  =4 . 59  p<,012).  Figure  19  depicts  the 
average  observed  and  weighting  efficiencies  across  all  equal 
a  conditions  (all  a  levels  and  r  values)  plotted  against  the 
number  of  group  members  (m) .  Figure  19  shows  a  decrease  in 
observed  efficiency  with  an  increasing  number  of  group 
members  (m) .  The  two-member  groups  performed  at  levels 
around  0.90  while  the  efficiency  of  the  larger  groups  de¬ 
creased  to  levels  around  0.60.  The  error  bars  represent  the 
standard  deviations  for  all  of  the  trial  block  efficiency 
measures.  Table  12  lists  the  average  observed  and  weighting 
efficiencies  for  each  group  size  and  difficulty  distribu¬ 
tion. 

There  were  no  large  effects  on  overall  or  weighting 
efficiency  due  to  dif f iculty(o) ,  or  inter-member  correlation 
(r).  For  "obs  F(4,26)=3.11  p<.047)  (r,  F{2,26)=4.27 
p<.05))  and  for  "weight  F(4,26)=3.39  p<.036)  (r, 
F(2,26)  =.445  p<.511)). 

Table  12  lists  the  averages  of  all  of  the  efficiency 
measure  values  as  well  as  the  values  for  the  unequal  a 
condition.  The  unequal  a  condition  displayed  very  close  to 
ideal  weighting  efficiency  (0.988).  The  weighting  efficien¬ 
cy  measures  varied  very  little  across  conditions  (standard 
deviation  =  0.122).  This  was  equal  to  about  half  of  the 
variability  of  the  overall  efficiency  (standard  deviation  = 
0.223).  The  values  of  the  standard  deviations  of  these 
efficiencies  across  the  different  group  sizes  are  shown  in 
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Figure  19.  Efficiency  measures  plotted  versus  group  size 
(m) .  Observed  efficiency  ("obs^  equal  difficul¬ 

ty  conditions  is  plotted  with  the  solid  line.  Weighting 
efficiency  ("weight^  shown  by  the  dotted  line. 

Standard  deviations  of  the  efficiency  measures  are  also 
plotted.  The  plotted  values  are  based  on  12  to  32 
blocks  of  trials. 
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Table  12. 

Efficiency  measures  for  group  performance  averaged  over  each 
experimental  condition.  All  of  the  experimental  conditions 
for  a  given  size  group  were  used  to  determine  the  average 
and  standard  deviations  for  each  these  measures. 
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DISCUSSION 


Individual  group  members  performed  consistently  across 
trial  conditions  and  throughout  the  study.  This  shows  that 
measured  group  performance  was  due  to  changes  in  the  experi¬ 
mental  conditions  and  not  to  fluctuations  in  individual 
performance.  The  difficulty  (o)  of  the  trials  directly 
affected  both  individual  and  group  performance.  As  the 
standard  deviation  of  the  presented  stimuli  (o)  distribu¬ 
tions  became  larger,  performance  (d')  declined  in  the  pre¬ 
dicted  manner,  consistent  with  previous  studies  (Montgomery 
&  Sorkin,  in  press;  Sorkin  et  al.,  1991).  The  consistency 
of  individual  performance  suggests  that  the  individual 
members  performed  during  the  group  trials  at  their  measured 
performance  (d’)  levels,  thus  allowing  us  to  predict  group 
performance  (d'gj.p)  using  the  ideal  model.  However,  there 
was  no  way  to  completely  account  for  day-to-day  variability 
and  differences  in  individual  performance  during  the  group 
trials.  A  secondary  finding  was  that  individual  differences 
were  small,  suggesting  that  there  would  be  little  benefit 
for  the  groups  to  differentiate  individual  performance 
during  equal  o  group  interactions. 

An  important  finding  is  that  actual  group  performance 
(d'grp)  increased  with  each  additional  group  member,  as 
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predicted  by  the  ideal  equation.  However,  there  were  de¬ 
creasing  benefits  with  each  additional  group  member;  six  and 
seven-member  groups  showed  very  small  improvements  over  four 
member  groups. 

Another  crucial  factor  in  the  group  decision  process  is 
the  correlation  between  group  members'  estimates  (r). 
Correlation  between  informational  sources  leads  to  a  reduc¬ 
tion  in  the  variability  across  sources  and  therefore,  possi¬ 
ble  group  performance.  Group  performance,  under  the  corre¬ 
lated  condition,  was  less  than  the  independent  condition  as 
can  be  seen  in  Figure  8.  The  improvement  in  performance 
gained  by  each  additional  group  member,  during  the  correlat¬ 
ed  condition,  was  less  than  the  independent  condition.  In 
a  sense,  by  displaying  correlated  informational  sources,  we 
were  not  adding  additional  group  members  but  partial  per¬ 
formers  . 

An  enlightening  example  of  how  high  correlations  bet¬ 
ween  group  members  can  lead  to  decreased  group  performance 
can  be  shown  in  an  aircraft  mishap.  For  excunple,  when  the 
members  of  an  Air  Florida  flight  crew  all  concentrated  on 
the  same  single  display  gauge  their  input  data  was  essen¬ 
tially  perfectly  correlated.  As  a  consequence,  key  data 
from  several  other  independent  sources  were  ignored.  They 
unknowingly  crashed  a  landable  airplane  in  the  Florida 
Everglades,  killing  everyone  on  board,  partly  due  to  a  in¬ 


crease  in  inter-member  correlation. 


80 


As  our  results  suggest  and  previously  suggested  by 
Hogarth  (1978),  it  may  be  beneficial  to  add  group  members 
that  lower  the  r  value.  Moreover,  when  making  selections 
for  decision  making  groups,  a  "yes"  woman/man  is  not  the 
best  addition  to  the  group.  Someone  who  is  not  afraid  to 
say  what  she/he  really  believes  can  lower  the  inter-member 
correlation  and  raise  group  performance. 

The  groups  appeared  to  differentiate  the  differences 
between  individual  members  during  conditions  where  the 
variability  of  member  performance  was  large.  However,  the 
individual  weights  appeared  to  be  random  when  the  variabili¬ 
ty  of  member  performance  was  small.  Prior  research  on  group 
decision  making  suggests  that  groups  tend  to  treat  all 
information  sources  "as  if"  they  were  equal  and  disregard 
differences  in  information  (Wickens,  1989).  Our  results  in 
the  unequal  difficulty  (o)  trials  are  an  exception  to  these 
findings.  The  unequal  o  condition  showed  that  the  groups 
could  differentiate  and  effectively  weight  the  sources  of 
information.  The  group  assigned  more  weight  to  information 
from  the  more  reliable  members  and  did  not  treat  the  infor¬ 
mation  "as  if"  it  were  equal. 

In  the  equal  a  conditions,  the  groups  may  have  reasoned 
that  small  individual  differences  in  performance  ability 
were  not  worth  evaluating.  The  groups  may  have  chosen  to 
satisfice  and  speed  up  the  interactions,  thereby  receiving 
most  of  the  payoffs  with  less  cognitive  workload.  Humans 
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have  been  shown  to  be  heuristical;  looking  for  cognitive 
shortcuts  to  answer  questions  quickly  (Tversky  &  Kahneman, 
1973) . 

The  group  efficiency  measures  showed  that  the  overall 
group  efficiency  declined  with  the  number  of  group  members, 
and  that  the  groups  utilized  a  moderately  effective  weight¬ 
ing  strategy.  Figure  8,  displaying  the  a=3.0  condition, 
showed  that  the  data  could  be  fit  well  with  a  correction 
factor  proportional  to  the  number  of  group  members  (m). 
This  correction  factor  may  be  in  the  form  of  an  additional, 
additive  noise  that  each  group  member  adds  to  the  group. 
Although  it  is  improbable  that  each  new  group  member  adds  an 
identical  noise  value,  the  correction  factor  suggests  some 
important  ideas  about  the  best  group  size.  Since  the  cor¬ 
rection  factor  relates  group  size  to  actual  group  perfor¬ 
mance,  it  may  be  possible  to  define  a  desired  level  of 
performance  and  choose  the  corresponding  size  of  the  group. 
Likewise,  the  decreasing  returns  in  group  performance  as  the 
group  became  larger  is  an  important  finding. 

The  relatively  high  observed  efficiency  measures  ("obs^ 
suggest  that  the  model  of  the  Ideal  Group  (Sorkin  &  Dai, 
1994)  is  an  effective  predictor  of  group  performance.  The 
weighting  efficiencies  were  consistently  high  across  all 
groups,  decreasing  very  little  as  m  increased.  Thus,  the 
decreases  in  observed  efficiency  ("obs^  with  additional 
group  members  cannot  be  explained  by  losses  in  weighting 
strategies. 
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The  groups  were  able  to  assign  weights  ideally  when  the 
differences  in  individual  performance  were  important. 
Nevertheless,  even  in  the  unequal  a  condition  there  may  have 
been  some  inappropriate  weighting  strategies.  For  example, 
weights  may  have  been  somewhat  biased  by  social  interaction 
characteristics  during  the  unequal  o  group  trials.  S7  and 
83  were  highly  interactive,  as  was  85.  However,  83  was 
reluctant  to  interact  during  the  group  trials  and  was  re¬ 
served  when  she  did  speak  during  a  trial  as  seen  in  Table  9. 
As  Table  7  showed,  the  two  unequal  a  conditions  where  82 
observed  difficult  (a  =  3.0)  information  during  the  trials 
produced  larger  d'  values  than  when  82  received  less  diffi¬ 
cult  (a  =  1.5)  information.  Even  when  they  observed  diffi¬ 
cult  information  to  discriminate,  87  and  83  received  slight¬ 
ly  more  weight  than  ideal  (as  shown  in  Figure  13).  In 
hindsight,  it  would  have  been  beneficial  to  have  a  more 
objective  measure  of  the  individual  subject  tendencies  than 
notes  taken  during  the  group  interactions. 

It  is  important  to  consider  the  additional  weight 
assigned  to  the  group  member  who  was  told  to  respond  for  the 
group  during  the  trial.  As  Figure  17  showed,  a  member 
typically  received  more  relative  weight  when  they  responded 
for  the  group  than  when  they  were  just  a  part  of  the  group. 
The  responder  would  ideally  be  an  unbiased  integrator  of  the 
incoming  information  and  respond  according  to  the  informa¬ 
tion  transmitted  by  the  group  members.  But  this  was  not  the 
case,  and  group  responder  received  more  weight. 
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This  finding  has  significant  implications  on  how  group 
tasks  are  designed.  The  assigiiment  of  supervisory  titles, 
as  often  is  the  case  for  the  group  responder,  frequently 
carries  more  weight  and  could  result  in  a  non- ideal  weight¬ 
ing  strategy  (Samuelson  &  Allison,  1994).  Within  a  resource 
allocation  task,  Samuelson  and  Allison  found  that  the  as¬ 
signment  of  supervisory  titles  to  a  member  of  the  group  led 
the  "supervisor”  to  take  more  than  their  fair  share  of  the 
resources.  It  is  important  for  members  of  a  group  to  real¬ 
ize  that  when  they  are  to  respond  for  the  group,  she/he 
tends  to  receive  more  weight  than  the  other  group  members. 
If  the  group  wants  to  perform  ideally,  they  should  avoid  a 
bias  to  give  their  own  judgment  more  weight. 

In  order  to  gain  a  better  understanding  of  why  observed 
efficiency  decreased  in  larger  groups,  we  need  to  examine 
some  possible  explanations.  Individual  performance  (d'j^) 
may  have  decreased  during  group  performance  due  to:  social 
loafing,  the  free  rider  effect,  the  sucker  effect  (Shepperd, 
1993),  and  a  group  resignation.  When  individuals  become 
part  of  a  group,  there  is  a  tendency  for  members  of  the 
group  to  loaf  and  neglect  responsibility  for  the  group's 
actions;  Especially  if  the  individual's  efforts  are  uniden¬ 
tifiable  (Latane,  Williams,  &  Harkins,  1979);  similar  to  the 
current  study. 

Shepperd 's  (1993)  review  paper  offers  an  expectancy 
theory  account  of  several  reasons  why  individual  effort  and 
performance  (d'j^)  may  have  decreased  during  the  group  perf- 
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ormance.  When  an  individual  is  put  into  a  group  and  she/he 
believes  her/his  contribution  to  the  overall  goal  is  unim¬ 
portant,  she/he  is  tempted  to  free-ride  on  the  coattails  of 
the  others  in  the  group  and  still  receive  the  group  benefits 
(Olson,  1965;  Kerr  &  Bruun,  1983;  Williams  &  Karau,  1991). 
This  may  have  occurred  in  the  current  study  because  the 
members  of  the  group  all  receive  the  seune  monetary  incentive 
for  their  performance  and  the  individuals  are  free  from 
separate  evaluation  (Harkins  &  Jackson,  1985). 

Additionally,  observations  made  by  the  experimenter 
during  the  difficult  (o=3.0)  group  trials  showed  an  almost 
helpless  attitude  of  some  group  members.  When  the  group 
task  became  very  difficult  and  there  was  no  clear  group 
decision,  several  of  the  group  members  tended  to  loaf  and 
not  interact  fully.  This  perceived  sense  of  resignation 
(learned  helplessness)  may  have  affected  the  group  results 
and  could  be  detrimental  to  group  performance  in  other 
tasks. 

Another  loss  in  individual  effort  may  have  occurred 
because  the  threat  of  free-riding  was  present.  Individuals 
may  have  reduced  their  effort  in  order  to  avoid  being  taken 
as  a  "sucker"  by  the  free-riders  in  the  group  (Orbell  & 
Dawes,  1981).  An  individual  who  feels  she/he  is  being  used 
to  perform  more  than  her/his  fair  share  of  the  work,  while 
others  benefit,  may  reduce  her/his  own  effort. 

Shepperd  (1993)  examined  an  additional  problem  that  the 
groups  may  have  encountered  in  the  current  study.  The 
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decreasing  benefits  of  each  new  group  member  might  be  ex¬ 
plained  by  a  coordination  loss.  When  the  size  of  the  group 
(m)  increased,  the  ability  of  the  group  to  perform  effec¬ 
tively  may  have  decreased  due  to  a  loss  in  coordination.  An 
example  of  a  loss  due  to  coordination  can  be  seen  in  a  game 
of  "tug-of-war".  When  there  are  two  members  in  a  group  they 
can  effectively  communicate  and  pull  in  the  same  direction, 
at  precisely  the  same  moment.  However,  as  the  tug-of-war 
group  grows  in  size  it  becomes  more  difficult  for  the  group 
to  effectively  communicate.  Some  members  may  pull  at  dif¬ 
ferent  times  and  in  slightly  different  directions. 

There  are  several  important  practical  eind  theoretical 
implications  that  stem  from  the  current  study.  These  find¬ 
ings  may  be  helpful  in  increasing  actual  group  performance 
and  in  understanding  group  decision  processes  in  the  future. 

In  order  to  gain  a  better  understanding  of  the  actual 
group  performance,  the  variation  of  individual  performance 
across  conditions  needs  to  be  examined.  It  would  not  be  a 
simple  change,  but  it  may  be  beneficial  in  the  future  to 
monitor  individual  performance  simultaneously  with  group 
performance.  This  could  also  act  as  a  deterrent  to  social 
loafing. 

Within  the  context  of  the  current  task  description,  I 
think  there  is  a  point  at  which  the  benefits  of  additional 
group  members  are  negated  by  the  additional  costs  and  prob¬ 
lems  that  each  new  member  adds  to  the  group  decision  pro¬ 
cess.  Tradeoffs  associated  with  large  groups  involve: 
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additional  noise,  coordination  loss  and  declining  benefits 
with  each  member  against  the  small  performance  increase  each 
group  member  adds  to  the  group.  I  suggest  a  compromise  of 
four  group  members.  Four  members  would  be  an  excellent 
combination  of  group  performance  and  the  reduced  efficien¬ 
cies  associated  with  the  six  and  seven-member  groups.  Of 
course,  the  cost  of  making  a  mistake  should  play  a  part  in 
how  many  group  members  are  included  in  a  decision  making 
group.  As  our  results  demonstrate,  if  the  cost  of  a  mistake 
is  great,  then  the  more  group  members  the  better. 

The  groups  may  have  assigned  weights  partially  based  on 
a  non- ideal  strategy.  Several  observations  were  made  that 
suggested  loudness  or  latency  of  response  were  used  as 
weighting  cues  during  some  group  interactions.  There  could 
be  an  effective  way  to  conduct  future  research  by  measuring 
social  interaction  characteristics  in  order  to  gain  a  more 
complete  understanding  of  the  group  weighting  process. 

Some  suggestions  for  training  effective  decision 
making  groups  also  follow  from  our  current  study.  Groups 
need  to  be  taught  that  social  loafing  and  coordination  loss 
are  likely  to  occur,  especially  as  group  size  increases,  and 
to  be  alert  for  these  problems.  Another  valuable  lesson 
would  be  to  train  individuals  to  recognize  personality 
differences  but  to  concentrate  on  actual  performance  abili¬ 
ties.  Loudness  and  affinity  for  interaction  are  not  always 
the  best  performance  indicators. 
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Similarly,  groups  need  to  be  aware  that  the  group 
responder  typically  receives  more  weight  during  the  group 
interaction.  If  the  group  response  can  not  be  randomly 
distributed  between  the  group  members,  then  the  group  re¬ 
sponder  needs  to  be  an  efficient  integrator  of  information 
and  preferably  the  best  performer  in  the  group. 
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APPENDIX 

LUTFI'S  CORRELATIONAL  WEIGHTING  ANALYSIS 
It  is  enlightening  to  evaluate  the  relative  weight 
(influence)  of  each  group  member  during  the  group  interac¬ 
tion  and  decision.  Similarly,  by  evaluating  deviations  from 
ideal  weights  we  may  gain  a  better  understanding  of  the 
inefficiencies  in  the  group  interaction.  According  to 
Sorkin  and  Dai's  (1994)  group  model  employing  Signal  Detec¬ 
tion  Theory  (Green  &  Swets,  1966;  Green,  1994),  during  the 
group  decision  process,  the  group  assigns  weights  (a^^)  to 
each  individual's  estimate  of  their  observation  (Xj^)  to 
reach  a  group  decision  statistic  (Z). 

The  relative  weight  assigned  to  each  individuals' 
observations  in  the  current  study  was  estimated  using  a 
correlational  weighting  technique  (Lutfi,  in  press).  Lut- 
fi's  analysis  is  similar  to  COSS  (Conditional  on  a  single 
stimulus)  analysis  suggested  by  Berg  (1989),  except  that 
Lutfi 's  correlational  analysis  offers  a  least-squares  es¬ 
timate  of  weights  instead  of  a  maximum  likelihood  estimate. 
The  correlational  weighting  analysis  was  used  because  it 
makes  no  assumptions  about  independence  between  observers. 

Since  the  correlational  method  for  deriving  weights  is 
based  on  some  of  the  same  principles  as  COSS  analysis  we 
will  briefly  review  COSS.  COSS  analysis  is  a  powerful 
tool  that  can  be  used  to  determine  the  weights  assigned  to 
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multiple,  independent  sources  of  information.  This  analysis 
enables  the  experimenter  to  evaluate  the  separate  effects  on 
an  observer's  response  due  to  small  changes  in  the  values  of 
independent  elements  over  a  block  of  trials.  These  effects 
on  the  observer's  response,  which  are  caused  by  the  pertur¬ 
bations  in  the  elements,  are  referred  to  as  COSS  functions. 
A  COSS  function  is  a  psychometric  function  with  the  prob¬ 
ability  of  responding  signal  plotted  on  the  y-axis  and  the 
value  of  the  informational  source  along  the  x-axis.  In  order 
to  analyze  the  weights  assigned  to  each  source  of  informa¬ 
tion,  a  COSS  function  is  determined  for  each  element  inde¬ 
pendent  of  all  of  the  other  elements  in  the  trial.  By 
measuring  the  slope  of  these  COSS  functions,  a  maximum 
likelihood  estimate  for  each  of  the  relative  weights  given 
to  each  element  of  a  multi-element  display  can  be  deter¬ 
mined.  Therefore,  the  steeper  the  slope  of  a  COSS  function, 
the  more  weight  given  to  that  particular  element  in  the 
display.  Furthermore,  Berg  (1989)  proposed  that  the  weights 
evaluated  using  COSS  analysis  are  not  biased  by  the  informa¬ 
tion  content  of  the  elements  or  by  additive  sources  of 
internal  noise. 

The  COSS  analysis  has  demonstrated  to  be  beneficial  in 
several  research  areas.  For  instance,  it  was  used  in  a 
hearing  detection  task  (Berg  &  Green,  1990)  to  determine 
which  channel  is  given  the  most  weight.  It  was  also 
utilized  in  a  short  duration  visual  detection  task  (Sorkin 
et  al.,  1991)  to  determine  which  gauges  are  given  the  most 
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weight.  Furthermore,  COSS  estimates  were  used  to  show  that 
observers  can  use  emergent  cues  to  correctly  weight  informa¬ 
tion  in  a  multiple  gauge,  visual  detection  task  (Montgomery 
&  Sorkin,  in  press).  However,  the  assumption  of  independent 
observations  that  COSS  analysis  requires  will  fail  in  the 
current  study  (r=0.25).  It  was  for  this  reason  that  the 
correlational  method  of  weighting  will  be  employed. 

Correlational  Weighting  Analysis 

Assiime  that  three  individuals  view  separate  displays 
made  up  of  nine  gauges  as  shown  in  Figure  3,  and  interact 
freely  to  make  a  group  decision.  Group  members  1,  2,  and  3 
are  presented  stimulus  values  that  are  normally  distributed 
and  are  statistically  independent  with  variance 
and 

The  decision  process  for  the  group  is  demonstrated  in 
Figure  1.  The  decision  rule  assumes  that  the  group's 
response  is  determined  by  the  value  of  a  decision  variable, 
Z.  The  group  decision  variable,  Z,  is  based  on  a  weighted 
sum  of  the  estimates  of  observations  made  by  group  members 
1,  2,  and  3  ,  X2,  and  X3)  with  error  (e).  This  value  is 

shown  for  the  group  in  equation  Al. 

Z=  a^^XQ^  +  a2X2  +  ^3X3  +  e  (Al) 

The  variables  a^,  a2,  and  a3  represent  the  relative  weights 
assigned  to  the  estimates  made  by  group  members  1,  2,  and  3 
respectively,  and  e  is  the  sum  of  all  additive  errors.  This 
error  may  be  due  to  noise  in  the  information  displays  or 
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additional  noise  during  the  interaction  process.  Since 
X2/  and  X3  are  assumed  to  be  independent,  equation  A1  is  the 
general  equation  for  multiple  linear  regression.  (Agresti  & 
Finlay,  1986,  p. 249-251).  Therefore,  Z  is  the  dependent 
variable  and  x^^,  X2,  and  X3  are  the  linear  predictor  varia¬ 
bles  in  equation  Al.  The  total  variance  in  the  dependent 
variable,  Z,  can  be  separated  into  four  parts:  the  four 
parts  would  include  Z's  relation  to  x^^,  X2,  and  X3,  respec¬ 
tively,  and  the  variance  that  is  left  over.  (Lutfi,  in 
press) 

0^2  =  +  a22o2x2  +  ^3202,^3  +  (A2) 

Equation  A2  can  be  rewritten  by  expressing  each  variable  as 
a  proportion  of  the  total  variance  accounted  for, 

^  =  i^^Zxl  +  ^^Zx2  +  /^Zx3  >^Ze  •  (A3) 

The  correlation  coefficients  ^zxl'  Pzx2'  ^Zx3  then 

be  calculated  by  using  linear  least-squares  regression  of  Z 
on  Xj,  Z  on  X2,  and  Z  on  X3. 

The  weights  that  we  are  estimating  correspond  closely 
to  the  regression  coefficients  in  the  analysis  above.  These 
relative  weights  are  computed  by  the  formulas  a^  =  /zxl  *^Z  / 
^xl'  ®2  =  >Zx2  ^Z  /  ‘^xZ'  ®3  =  >Zx3  ^Z  /  ®x3'  Conse- 
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quently,  these  equations  can  be  used  to  form  an  equation  for 
the  relative  weights  1 

_  >Zxl  ^x2 
^2  >Zx2  ^xl 
>Zxl  °x3 
>Zx3  °xl 

Now,  all  that  is  required  to  solve  for  the  relative  weights 

are  the  estimates  for  /zxl'  ^Zx2  y^Zx3* 

Since  Z  in  the  current  study  corresponds  to  the  group's 
subjective  decision  variable,  it  is  impossible  to  obtain 
direct  estimates  of  >zxl'  ^Zx2  ^Zx2'  Therefore,  we  are 
forced  to  estimate  >zxl'  ^Zx3  group  respon¬ 

se's  relation  to  each  group  member's  observation  (sum  of 
stimulus  values).  Response  (R)  is  either  signal  (R^)  or 
noise  (Rq)/  ®nd  therefore  is  a  dichotomous  variable.  During 
the  group  trials,  we  assume  the  individual  observers  base 
their  estimates  (x^^)  on  the  values  of  the  stimuli  on  the 
vertical  gauges.  Based  on  this  assumption  the  sum  of  the 
stimulus  values  for  each  group  member  (Sj^)  was  used  to 
estimate  the  influence  given  to  each  individual  member.  We 
calculated  the  point-biserial  correlations,  rpx2 

rRx3 ,  between  the  group  response  and  the  observers '  sum  of 
elements  (Sj^)  to  estimate  >zxl'  <^Zx2  /Zx3-  These  corre¬ 

lations  are  standard  product-moment  correlations  and  can  be 
computed  from  standard  formulas,  over  a  block  of  trials. 
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i  .e. 

nZRSj^  -  2R2Si 

VnER^  -  (ZR)^  (28^)^.  (A5) 

The  correlational  formula  for  the  relative  weights  are  then: 

®1  _  ^Rxl  ^x2 

^2  ^Rx2  °xl 

®1  ’^Rxl  ^x3 

^3  ^Rx3  ^xl 


Where  ^Rx2'  ^Rx3  point  biserial  correla¬ 
tions  between  the  sum  of  the  stimulus  values  presented  to 
each  group  member  (Sj^)  and  the  group  response  (R).  n^i/  Ox2> 
and  ay^2  standard  deviations  of  the  stimulus  distri¬ 
butions  presented  to  each  observer  and  represent  the  diffi¬ 
culty  of  information.  To  estimate  the  relative  weights  for 
larger  groups  equation  A6  above  is  extended  in  sequence.  To 
solve  for  the  actual  relative  weights,  we  assume  relative 
weight  a^  =  1  and  Oj^  =  Oj^  for  all  i  (equal  difficulty  dis¬ 
tribution  case).  The  two  equations  have  three  weights, 
therefore  by  arbitrarily  assigning  a^^  =  1,  the  relative 
weights  can  be  solved.  The  relative  weights  are  then  nor¬ 
malized  to  allow  comparisons  between  conditions.  In  order 
to  normalize  the  weights,  each  individual  weight  is  divided 
by  the  sum  of  all  the  individual  weights. 

An  example  is  given  below  to  show  how  Lutfi's  correla¬ 
tional  analysis  is  used  to  derive  the  relative  weights.  A 
group  of  four  individuals  receive  independent,  equal  a 


98 


information.  Again,  we  assume  that  the  subjects  followed 
instructions  and  are  using  the  stimuli  values  to  make  their 
estimates.  Therefore,  the  sum  of  the  stimulus  values  would 
provide  a  good  estimate  of  each  individual's  observation. 
The  individual  then  conveys  information  about  her/his  ob¬ 
servation  to  the  group  during  the  group  interaction. 
represents  the  point-biserial  correlation  between  group 
member  1 '  s  sum  of  the  stimulus  displays  ( S]^ )  and  the  group '  s 
response  (R),  over  a  block  of  100  trials.  In  order  to 
determine  the  normalized  relative  weights,  these  correla¬ 
tions  along  with  the  (difficulty  of  each  of  the  subject's 
information)  are  substituted  into  equation  A6.  The  standard 
deviation  of  a  single  stimulus  display  gauge  (Oi)/  is  re¬ 
ferred  to  as  the  difficulty  of  the  information.  In  order  to 
determine  the  relative  weights,  the  standard  deviation  of 
the  entire  stimulus  display  screen  needs  to  be  calculated; 
for  a  sum  of  normal  values,  this  is  where  n  is  the 

number  of  stimulus  gauges. 

An  example  of  the  group  data,  with  four  members,  shows: 


^Rxl  " 

.37 

=  1.5 

for  all  OjL 

^Rx2  " 

.23 

standard 

deviation  of  the 

^Rx3  = 

.19 

stimulus 

display  =  1.5  /  3 

^Rx4  “ 

.24. 

=0.50 

Substituting  these  values  into  the  relative  weights  equation 
above  would  give  the  following  values, 

^1  ^Rxl^2  (.37)* (.5) 


^Rx2^1 


(.23)*(.5) 


1.609 
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^1 

^Rxl'^3 

(.37)*{.5) 

^3 

^RxS'^l 

(.19)*(.5) 

^1 

^Rxl'^4 

(.37)*(.5) 

^4 

^Rx4®l 

(.24)*{.5). 

After  substituting  =  1  into  the  equations  above  the  rela¬ 
tive  weights  will  be: 

a^  =  1/  32  ~  .622,  33  =  .514,  a^  =  .649 

In  order  to  normalize  the  weights,  we  divide  each  relative 
weight  above  by  the  sum  of  the  weights,  then 

a^^  =  .36,  ^2  —  .22,  33  =  .18,  and  a^  =  .23. 

From  this  example,  we  see  that  group  member  1  has  a 
higher  relative  weight  than  the  other  observers  during  the 
interaction.  Consequently,  we  conclude  that  during  the 
group  interaction,  the  group  assigns  the  most  influence  to 
what  member  1  says  and  the  least  influence  to  what  member  3 
says . 

Statistical  Significance  of  Weights 

The  correlational  method  of  estimating  the  relative 
weights  given  to  different  sources  of  information  is  based 
on  a  multiple  regression  analysis  of  trial-by- trial  data. 
This  method  of  analysis  makes  it  possible  to  do  statistical 
tests  on  the  relative  weights  assigned  to  each  observer. 
Tests  of  statistical  significance  can  be  performed  using 
standardized  Z-scores.  The  expression  for  the  point-biseri- 
al  correlation  (equation  A5)  is  very  similar  to  the  expres- 


Sion  for  the  standardized  difference  between  means. 


Si(0)  -  Si(i)  ^ - 

tRxi  =  -  -^PoPl 

^si 


(A7) 


where  (^1(1))  PQ  ^Pl^  are,  respectively,  the  mean 

value  of  Sj^  and  the  proportion  of  trials  for  which  the 
response  was  noise  (Rq)  signal  (Rj^).  The  test  for  the 

significance  of  and  therefore  the  weight,  is 


Z  = 


■Rxi 


(A8) 


1  /  Vn“ 

where  n>30  trials,  1  /  may  be  used  as  the  standard  error 
of  Using  equation  A8,  we  can  test  the  significance 
of  correlations  between  each  observer's  sum  of  elements  and 
the  group  response  (R) .  It  can  be  determined  if  the  weights 
are  statistically  different  from  one  another  by  substituting 
the  difference  in  correlations  between  observers  “ 
rRjj2)  into  the  numerator  of  equation  A8.  Equation  A8  can 
also  be  used  to  determine  confidence  intervals  for  the 
weights. 

Another  benefit  of  the  correlational  weighting  analysis 
is  that  it  can  account  for  non-independent  observations.  If 
the  inter-member  correlation  (r)>>  0,  then  the  partial 
correlation  (tpjji*x2^  substituted  into  equation  A6 
to  determine  the  relative  weights.  The  partial  correlation 
measures  the  correlation  between  an  observation  and  the 
group  response  while  accounting  for  the  other  observations' 
relationship  to  the  group  response.  In  groups  with  more 
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than  two  members,  higher  order  partial  correlations  need  to 
be  used  (rRXi-x2,  x3,  x4)- 

During  the  current  study,  the  inter-member  correlations 
(r)  were  either  experimentally  set  to  0.0  or  0.25.  The 
actual  inter-member  correlations  (between  observations)  were 
analyzed  and  checked  for  statistical  significance  at  the  p 
value  (two-tail)  =  .01  on  all  conditions.  All  actual  inter¬ 
member  correlations  in  the  r=0.25  experimental  condition 
were  not  statistically  different  from  0.25.  The  relative 
weights  for  these  conditions  were  then  evaluated  using 
partial  correlations.  Additionally,  due  to  random  error  it 
is  likely  that  r  >>  0.0  for  some  of  the  r=0.0  experimental 
conditions.  The  actual  correlations  in  this  condition  were 
tested  at  the  same  p  value.  Out  of  all  the  possible  corre¬ 
lations,  only  four  were  found  to  significantly  different 
from  zero.  Based  on  the  large  number  of  correlations  and  a 
Monte  Carlo  simulation,  these  were  assumed  to  be  due  to 
random  error  and  partial  correlations  were  not  utilized  in 
the  r=0.0  condition. 

The  partial  correlations  can  be  tested  for  significance 
by  adjusting  the  standard  error  used  in  equation  A8.  In  the 
first  order  partials  (group  of  2  members)  the  denominator  of 
equation  A8  becomes  l/vN-4.  For  second  and  higher  order 
partial  correlations  the  appropriate  test  for  significance 
of  the  correlation  becomes: 
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^Rxl ' x2 , x3 , . . . xm 

Zs  n— — .  I—  I. 

l/J^~  -  (m  +  3)  (A9) 

where  m  is  the  number  of  variables  partialled  out  (Thorn¬ 
dike,  1978). 
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